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Les introduer ren 


In the following chapters we prove various results Tomecoi lemme s 
systems governed by functional differential equations of neutral type. usec 


equations are generalizations of the equation 
x(t) + Ax(t-h) = Bx(t) + Cx(t=h) espa 


which has been studied extensively (for example, see Bellman and Cooke [4]). 

Chapter 2 contains results in the theory of neutral equations. The 
form of the left-hand side of equation (2.1) given by (2.3) was first used in 
Hale and Meyer [14]. The type of hereditary dependence employed here occurs 
especially in integral equations; although this dependence puts a different 
topology on the domain of the functions than that used in the original proofs 
Supemesmain theorems, the change does not alter the proofs significantly: 
Needless to say, the work of Professor Hale and his associates has greatly 
influenced many of the ideas and proofs in this thesis. 

In chapter 3 we develop the concepts which will be used to prove 
necessary conditions. The definitions of CI, X)y x and of a quasi-convex 
family are extensions of the definitions of AC(I,X), and of an absclutely 
quasi-convex family given in Banks [1]. The general approach of the proof 
of theorem 3.1 follows a proof given by Neustadt [21]; epee S| ee 
case of ordinary differential equations; Neustadt gives credit to Gamkrelidze 
[10; theorem 2.1] for many of the ideas of the proof. 

Chapter 4 contains three control problems and the corresponding 
necessary conditions, In addition, results for the third problem from a 
slightly different approach are stated without proof. The proofs use the 
properties of quasi-convex families in a manner similar to that of the proofs of 


Neustadt in [21] and [22], rather than the techniques of the Hamiltonian func- 








tion and variations as used by Pontryagin et al. in [23]. Kamenskii and 
Khvilon [19] use the latter method to obtain necessary conditions for the equa- 


aon 


k(t) = f(x(t), x(h(t)), x(h(t)), u(t)). 


Although they allow nonlinearities in xX(h(t)), the rest of their assumptions 
are much more restrictive than those made below. Theorem 4.3 describes nec- 
essary conditions for driving a solution of the system equations to a terminal 
function rather than a terminal point; the author has not found any other such 
conditions in the literature. Although theorem 4.4 does not give conditions 
under which the multiplier wW is non-zero on a set of positive measure, chapter 
6 contains several examples with non-trivial v. 

The sufficiency conditions of chapter 5 are proved by a method first 
used by Rozonoer [24] for ordinary differential equations and cost functions 
which are linear in x. He pointed out [243 pp. 1412, 1420] the necessity of 
assuming om #0 in the case of a restrained terminal point. Halanay [11] 
extended Rozonoer'’s result to retarded equations in the case of a free end- 
point. Lee [20] obtained a more general sufficiency theorem for ordinary dif- 
ferential equations, In parts (B) and (C) of that theorem he states ex- 
fwreiuly that a? = -l; although he does not state a? # OU iapant. Grea. 
proof uses a lemma which requires a? <0. All of the above results except 
part (C) of Lee's theorem are included in theorem 5.1. Theorems 5.3 and 5.4 
on the existence of optimal controls are generalizations, from ordinary dif- 
ferential equations to neutral equations, of theorems 4.1 and 4.2 of Jacobs 
[18]. These are included to show a class of problems for which an optimal 


control exists; no attempt has been made to prove the most general existence 


=» 


theorem, 








The first part of chapter 6 shows the relation between certain types 
of hyperbolic partial differential equations with boundary controls and neutral 
equations with control. Other authors have shown that some hyperbolic partial 
differential equations can be inate slase neutral equations (see [5] and 
[7]}. Theorem 6,1 is a specialization of Besoin Nes to equations with one 
imec Jag and constant coefficients, a fixed initial funetion, and a fixecdez ines 
time, It can be understood independently of most of the rest of the thesis, 
requiring only some knowledge of such equations, lemma 3.3 (conditions for a 
‘family of functions to be quasiconvex), and remark 6 ( on) Mom=tirivaieiere. mony 
the multipliers). The last part of the chapter contains examples for which | 
problem 4.3 is normal and theorems 4.3 (or 6.1) and 5.2 prove certain controls 


are optimal. 








e. Neutral Equations 


We will work on an interval [%,,4), where -0 <a, < to < a < ™, 
A function h(x(*),t) may depend on any or all values x(s), a<s5< t. 


On C({a,t],R°) we use the norm |v, = sup - |¥(s)| (the subscript + 
a, S s<t 


may be ommitted). Throughout the discussion the following convention holds: 


If we Giana), t, <t<t<a, we also consider y « C(La,,t],R ) by 


O 
pane Vis) = v(t) for s ¢ [t,t]. x, denotes the restriction of x to 


[oo]. We note that this convention means for t, <a <t<a, x and x, 


6) 
are both elements of C(Lo,,t],R), but unless x is constant on f[oc,t] they 
Pe oworrerent functions. 


We consider the equation 


(2.1) , sel D(x(+),)] = £(x(+),*) 


Gogether with the initial condition 


(252) x(t) = p(t) on [a,, tI. 


femegai consider y to be a (local) solution of (2.1), (2.2) if there is a 
tT, t) <t <a, such that y satisfies (2.2) and satisfies (2.1) a.e. on 


[t), 7]. Unless otherwise stated we also require a solution y to be in 
n 
c({a, 7] »R Ne 


The following standing assumptions are made; 


ie 

(55) D(x(*),t) = xt) a: e(x(-),t) = ate) = f d [u(t ,@) ]x( 6) 
@ 
O 








for tb € [t,,2), where 


(2.4) 


(2.5) 


(2.6) 


2 
2 n 
u(o,@) =O for 6 >0, nh? R >R § uw Borel-measurable; yp continuous 


from the right in its first argument and contbinueus trem tie tet ie 
its second argument; nw of bounded variation on every finite interval 


in its second argument, and such that g(¥,s) is continuous in 


S € [t 2) for each y é€ C({a,,2) ,R°), (hence, continuous in (y,s) 


jointly). 


there exists a continuous non-decreasing function 6 such that, for 


each t€ [t,,4), for each € € [0,t-a], Var (te) 8c © jemand 


} 


S(O) = O- 


f(y,t) is measurable in t for each fixed We Yer) gs). rae eto} ote 
tinuous in wy for each fixed t, and for each compact en. wecre 
exists k(°) ¢€ ee (casey) such that |f(¥,s)| <k(s) for all 


Ss ¢€ [t,,@); We C([a,,4) ,X) « 


Remark 2.1. One condition which is sufficient to guarantee that g(¥,s) is 


continuous in s_ over [t,»4) for fixed y ¢€ C([a),a) »R") ie that MCeeOe 


J(s,@) + v(s,@), where 


ys 
n 
2) diag) = E _32)(8)XEh,( 8) 1(8)5 a 2 ROR and hy: RR are 
continuous, Q < h ,(s) ene [t,,4); f= Dee aud 


2 
X: R -BV(R,R” ) is given by 








X[h](t) = 


(Gas Che aad Sci yaaa) 


: 2 
b) for each s ¢€ [t,.2), A € C([o,a),R° ), and the map s > 


WiC Og ae > BV([a,,a),R° ) is continuous (note that this last 
condition, combined with v(s,s) = 0, implies v(-,@) continu- 


ous). 


Eeoome het & >0O, We C(La),a),R°) be fixed. Let So € [t 2); consider 
Ss € [t,,2)- 
From a), there exists 


implies 


p, >O such that | sso <0 


| a,(s5)-a,(s)| < TeSeD TAT? L= or ek 


From continuity of the h 


ik 


) and ¥ (henee equicontinuity on 


[t»8,+P,]), there exists 5, 0 <5 < P,, such that | s-s)| <p, implies 


€ 


| v(h(s,))-v(b(s) )| <[(2pe1) max Ta (s.\T 1 » £ = Lyoes Po 


L=l1,eo00,p 


From b), there exists Pr » ome Ox < P5, such that | s-s| < Px 


implies 
vane |S 5 ewes) < TrepaT 
[dysa) 9 oe 
aus for | s-so| < Pz SP 8 Py» 
a a 
le(¥,s))-e(v,s)| =1/ dofu(s,,6)]v(e) - J afu(s,e)]v(e)| 
o4 OF 


0 0 








= [1 ag v(sp,6)-v(s,0)V(8) 
“0 


+ W_ja,(s)¥(n,(s,)) - Z,_3a,(s)¥(h,(s) | 


Ul var Do sp")-W(80")1 + Feil @)(85) 11 va, (59)) -¥H,( 8) )| 
Q?* 


+ Dail 2p(%)-2,()1 1 ¥(h,(s))| 


ee 
+ Fecal 850) eR awe TELE 


L=1,000,)p 


2 


e 
+ ae pr vl| 


Theorem 2.1. Given (2.3)-(2.6), open 2 € C([ap,a),R), mM € C([a),to1,R') ans 


there exists a solution of (2.1), (2.2) over [A to+¥J for some yé (O,a-ty). 


Proofs The proof is the same as that of Hale and Cruz [13] theorem 4.1, in 
light of the remarks made in section 7 of that reference and the arguments 


given in Hale [12], pp. D, 16. 


Theorem 2.2. Given (2.3)-(2.6), 2 open in [a »@) x C([a,a),R'), x a non- 
Sedummuabie solution of (2.1), (2.2) on [%,), ty <b <a, (ts?) eQ. Then, 
iW = closure{(t,x,)8 té [t5»d)J is compact, there exists a sequence 


t, >b as ko such that (t,,x, ) ~dQ as k 0, 
k k ty 


Proofs The proof is the same as that of Hale and Cruz [13], theorem 5.1. 
Theorem 2.3. Given (2.3)-(2.7), 2 open in [A 2) x C([a,,4),R°), x a non- 
@emeanuable solution of (2.1), (2.2) on [d), ty <b <a, (to) eM. Then, 


fereany Compact set UC, there exists oe E (to,b) such that (t,x,) ¢ U 








toy’ RS Gan Gee a) 


Proof; One proof of this has been given by Hale, see [ 12], theorem 5.2. 


We now turn to linear equations, where 


t 
(2.7) e(x("),t) = f anf n(t,6)}x(@), % © [t),a) 
a 


under the conditions 
@ na 
fee n(d,6) = 0 for 6 >a, yn: R OR is measurable, of bounded variation 
on every finite interval in its second argument, n(o,-) left-continuous 
; 1! 
except at o, and there exists m € Ly ooh L tgs) 98) such that 


Perec, j= mo). 
[ao] 


Meomene.|. Given (2.4), (2.5), (2.8), the equations 


a t 

(2.9) Y(s,t) =E +f d [¥(a,t) Jua, s) - f Y(a,t)nla,s)da, s<t 
Ss S 

(2.110) Cen eI 

(2) MSE a Oy SF S56 


2 . 
. ; : 2 
Mamaneiy define a function Y. KR +R such that Y(s,t) is left-continuous 


eo in addition, for every M>0O, there exists a By (depending on M) 


such that for |t| <M, | t| Sol © Ver Gaye B 
ty) 


Proof; The proof of the existence of Y(s,t) is the same as that of Henry [ 15} 


y and |¥x(t,,t)| < By. 


u 


meme 1, The proof of the bound, due to Banks, is contained in Banks and 


Kent [13]. . 





Theoren 2.4. Let x = x(9,h) be the solution of 


t | t 
R(t) = D(P, to) + g(x(-) cu J ft xia lca if tite de eee a 
(2.12) % % 
Mie =<) 


fewest ¢ satisfy (2.3)-(2.5), (2.7), (2.8), he He (SSE): Then, 


nore t >t 


0 
to oe 
x(t) = ¥(t,,t)D(P,t,) + J ag{-J d [x(a t) Iu(a, 6) 
a 
(2715) " . ae 
+ f Y(a,t)n(a,B)dajp(B) + f Y¥(a,t)h(a)da 
26 % 


where Y(s,t) is given by (2.9)-(2.11). 
Pegg@ne The proof is similar to that of Henry [15], theorem e. 


Pemenme c.2. The proof does not use the continuity of x and 9, so they may 
be taken to be discontinuous functions in BV([o,,@),R°) as well as continuous 


functions; the theorem will still hold. (See Lemma 2.7). 
feutese.c, Given (2.4), (2.5), (2.8)-(2.11), Y(s,t) satisfies 


ie cae 
(2.14) ¥(s,t) = E+ f ao{u(t,e)]v(s,6) + ff agfn(a,6)]¥(s,@)aa 
iS Ss 


Proof: Using the methods of Hale and Meyer [14], theorem 2, from theorem 2.4 
t 

Peove we obtain that, if W(t,s) = -/ ¥(@,t)d@, then W(t,s) =O for s >t, 
S 


maa tor s < 16 
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a tA 
W(t, s) ee i d [u(+,@) IWC, s) ar i J dol n(r, 2) Jwee, s)dn ~ (t-s)E. 
% ae) oi 


By the bound in lemma 2.1, we may differentiate with respect to s under 


Mmiemiategrals, obtaining (2,14) after noting that, for 9s.) ceo 


Lemma 2.3. Suppose for some integer M we are given two (scalar) functions 

on [-M,M] X [-M,M], X(s,t) and m(t,s). Let X be Borel-measurable in (s,t), 
Sumeounced variation and left-continuous in s for each fixed 1, 

vay X(-,t) <K, all +t ¢ [-M,M], X(s,t) =0, s>+t. Let m satisfy (2.4), 

[ an M] 

fee and be of bounded variation in +t for each fixed s € [-M,Mj. Then 


Mt 
ad [X(a, t) Ima, s) is Borel-measurable in (t,s). 


Proof: There exist Borel-measurable m'(t,s), m (t,s) > 0, non-decreasing in 
+ 
meumeorecach fixed s, m'(t,s) =Mm(t,5) = Ohms ES ue var Trenton) = 
[-M, M] 
var m(t,-) < 8(2M), and m(t,s) = m'(t,s) -~m(t,s). Hence 
[ -M,M ut + 


M 
a) f a [x(a,t)Im(a,s) =f 4 [Xx(a,t)Im"(a,s) 
-M -M 


mt 


- - da [ X(a, t) sie(e re 


4 


There exist simple functions m,, given by m, (a, s) = 


N 
aan me (O,s), such that m, (a, s) + m'(a,s) as k—7o, These are deter- 
j=l kj A,. 
kj 
mined by the partitions 0 = a, <a 5<... <a, = S(2M), and 
kK 
+ ; 
AL; = ver, Se ag Sm ene = ie j41))) j = 1,...,N,-1, 


Ani, = {(a,s): m(a,s) = a) 








SSL 


By the Lebesgue Dominated Convergence Theoren, 


ut + 


N M 
Ga d {x(a, t) Im"(a, s) = lim ea d {x(a t) 1X, (Gris) 
-M k 30 JM JM kj 

For each s ¢€ [-M,M], B ¢ [0,&2M)], define u(sjp) = min{{a ¢ [-M,M): 
m (a, s) > B} U {M+1}]. Since m'(*,s) is non-decreasing and right-con- 
tinuous, u(°;6) is well defined. Fix B. For a € (-~,-M], (s: u(s;B) < a}=d, 


which is a Borel set. For a ¢€ (-M,M], 


(576) <a} = {s? there exists a © [—=Mja) with m'(a,s) >} 


It 


“s : 
U se) (Oye) ee nee U S(B) « 
ae[ -M, a) ae[ -M, a) 
, + . + ; 
Since m is Borel-measurable, {(a,s): m(a,s) >B} is a Borel set, and so 


ee c-section, SAB), is also a Borel set. Assume age  U SB) - Then 
ae[ -M, a) 
tiers exists a! € [-M,a) such that 6B <m(a',a). If at is irrational, 


* + e LJ e » 1 
since m(-,0) is non-decreasing there exists rational oa” ¢€ (a’,a) such 


that 6B <m(a',o). Thus, if Ra = (b €R: b is rational}, 


(seu 2) = U S(B) = U S(B) 
ae[ -M, a) ae[ -M, a)NRa 


ieeepore] set, since it is a countable union of Borel sets. Similariy, for 


a € (M,M+1], 


(stu(s38) <a} = U Sfp) = Uf) 
ae[ -M, M] ae -M, MJNRa 


mapa Borel set, For a € (M+l,o), (s: u(s;B) <a} = [-M,M], which is a Borel 


set. 








Since {s: u(s;8) <a} is a Borel Sei forjecchymenc 2 eur) ene 
Borel-measurable for each B < [0,8(2M)]. From its definition, u(s;-) is 
non-decreasing for each s € [-M,M]. Using the normalization X(s,t) = 0 
for s >t, without loss of generality we may extend the domain of X(-,t) 


to [-M,M+1], for each t €[-M,M]. Hence, from b) we obtain 


mM’ Sil 


c) : d [ x(a, t) jm” (a, s) 7 oe rk a1 2k; i Cas, a, 542))2*) 
: xCu(s,a,5),%)] - yy MUS, May 9 t)3- 


xCu(s,a,,),%) will be Borel-measurable in 9( sj t) yi ts, 0)) > (Ue) eee 


bemel-measurable, To check this, 1t is sufficient to look at Q = 


lig ke) 8, 1 
Q=u. “((25)2))s8) x (b5,b,), and a “((a,8) 58) is a Borel set, hence Q 


Gc): ao < W@sgiey) — 255) DA ae <b,} ner aa) a <a < De Bui 


is a Borel set. Thus (s,t) >(u(s,B),t), and also (s,t) > X(u(s, a5), t), 


Ny -1 
is Borel-measurable. For eack Kk, a PebelSereaiya®) . xCu(s, a5), t)] 


j=l “kj 
is a finite sum of Borel-~measurable functions, so it is Borel-measurable in 
M 
Mote By c), f d x(a, t) Jm"(a, s) is the limit of a sequence of Borel- 
-M 
measurable functions, hence it is Borel-measurable in (s,t). The same ar- 


guments hold with m replaced by m, so by a) the proof is done. 


P 


Remark 2.3. The simplest type of function u(t,@) satisfying (2.4), (2.5) 
and also of bounded variation in t is of the form u(t,0) = fi(t-6). This 


form occurs in equations with constant lags and constant coefficients. 


Lemma 2.4. If in lemma 2.1, for each @, u(*,0) is also of bounded variation 


on every bounded set in R, then Y is Borel-measurable in (s,t). 


Proof: Add to the induction hypothesis of the proof of lemma 2.1 that, where 








1) 


it exists, Y is Borel-measurable in (s,t). This Gs@¢rue tor  o7-so 


(s >t), and holds for the function Y°, 


A Vics e ) s > t-pe 
Y (s,t) = 
Nees a) St =tea 


k-1 , 
Then Y “(a,t)n(a,s) is Borel-measurable in (t,a,s); by [8, theorem III. 


M 
ei], f y(a,t) n(a,s)dc is Borel-measurable in (s,t). By lemma 2.4, 
“a -M 


M 

f a {x *(a, t) ]u(a, s) is Borel-measurable in (s,t). Thus (rewriting by 
-M 

Peonemties of Y, 2, and Yn) 


a M 


k : ees 
Y(s,t) =E+ o dy (ant) lECoys) J Xa, t) ato, s)do 


is Borel-measurable in (s,t). On the set [-M,M] xX [-M,M] N {(s,t): 
s >t-(p+1l)€}, ¥(s,t) = lim v'(s,t), so on that set Y(s,t) is Borel-measur- 
k70 
foeew by induction and the arbitrary choice of M, the proof 1s complete. 
Remark 2.4, Henry [ 15] makes the following definition: 
a na | 
F. R OR has property P if F(t,s) = Q(t,s) + 2 R (+) 
S+t (t)<t 
where the Te Ri (+) are continuous, IRC) | 
converges uniformly; Q(t,s) is continuous, absolutely continuous 


aS.) With BY ,s) continuous in t for each s_ and 


|Z(4t,8)] < a(s) (all +t) for some locally integrable q(°). 


He then shows ([{ 15], lemma 2) that if pw has property P, Y is Borel- 
Measurable in (s,t). It is possible for F to have property P and not 


be of bounded variation in t on bounded sets. For example, if q(s) is 


locally integrable, r(t) is continuous but not of bounded variation on finite 








14 


molervals, then 


F(t,s) = Q(t,s) is t 


-r(t)f a(a)dc, s<t 


has property P but is not BV in t. The following are two examples of 


mie@erons which are of bounded variation in t, but do not have property —P: 


Os. oS ae 
F(t,s) = Q&t,s) = | Cantor ternary function of (t-s), t-l<s<t 
dees s<t-l 


nieve iS not absolutely continuous in sg. 


0 PS eet 
HiGas) = Qt, sje) (tals) eee se tec eee 
I 9 8 Suse 


where @Q is absolutely continuous in s, but + 5) LS MOU CONtCEWMete i ss. 
ds 


Lemma 2.5. Assume (2.4), (2.5), (2.8)-(2.11), and there exists a A>O 
such that OA) =0. Let ty 2% +A and H(t,@) = J(t,@) + v(t,@) be 
as in remark 2,1, where in addition t <s implies h(t) < h,(s), and 
a < h,(s) —Joe-e formal! “s ¢ [tys4)5 ae eee hee VCsme ats 


Peenic=continuous. 


Proof: For t<s, Y(s,t) = 0; thus Y(s,°) is right-continuous on 


(-o,s), Fix T>s. By lemma 2.2 and the assumptions above, for t. < 
, or = 


J 
S St, 








are, 


1G 


Y(s,t) = B+ De_a,(t)¥(s,h,(t)) + J agl v(t, 9) 1¥(s,9) 
ic) 
| df n(r, 6) 1¥(s,@)aar. 
Ss Ss 


eq An = sup{|a,(t)|: to [uss ), 2 Sele) meal By is the bound on Y 


Soe ee 


_ given in lemme 2.1, for to 


A 


(oy 7)-¥(s,t)| <|2)_, 2,()2(s,me(q)) =. a, (aie, aa) 


t t 
+|J aglv(t,6)]¥(s,@) - f af v(t, 6) ]¥(s,¢)| 


AN t x 
+ |J f agtn(a,e)]y(s,e)aa - f f agi n(a, & Ix(s,e)aal 
ss Ss os 


< Uy iy Apl ¥(s,ny(4))-¥(s,8,(t))| + UP, Byla,(t)-a,(+)| 


ae aif 
+ Byl J dol (7, @)-v(t,@)]| + B, J m(d) dd. 


Since the a, are continuous, the second term goes to zeroas tT—t. By 


@eorepcolon b) of remark 2,1, the third term goes to zero as tT—>t. Clearly 
Giemrourth term goes to zero as T-+t,. Let +t ¢([s,s+A). Then, since 


Y(s,°) is right-continuous on (-~,s), the hy are continuous and non- 


decreasing, and h,(o) <o-A for o >t,, the first term goes to zero as 


OQ? 
tt. Hence Y(s,°) is right-continuous on (-~,s+A). We continue in 

this manner, showing Y(s,°) is right-continuous on (-~,s+jA) for j = 
1,2, 66-50, where Ny = greatest integer in (=I. faking Cue mMiOLe ween. 
mor t¢€ [s+ 4,17), we have that Y(s,°) is right continuous on (-~,T). 


peice this holds for each T >s, the lemma is proved. 
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Lemma 2.6. Assume (2.4), (2.5), (2.8)-(2.11), and there exists a A>O 


Puemethat 6(A) =O. Let ty > AotA, and u(t,@) = 30,0) + vl ye boas 


mo remark 2.1, where in addition ty 


coe |< h (s) <s-A forall sé [t,,@), 2 = 1,..2,D. Assumes tia enon game: 
t 
w € BV([a),2),R°), t é [t 528), the map s >f w(a)n(a,s)da is continuous on 


<t<s implies h(t) < h(s), and 


S 
Bees Then, if s,t ¢ [t,,a), W(s,t ) = y(s',t). 


Peoor, Since the hy are Strict yy vone cone = uac be are well defined and 


continuous, fZ= 1,...,p. Thus, by the representation of u, (2.9) becomes 








efi 


ie. 15) Y(855) Vis a ip cWaliedGerec) | ) 
seh [s,t+a]Nh?"[ s,~) | nee 


t* t 


+f a[¥(a,t)]va,s) - J x(a,t)n(a,s)da. 


Since vie.) is continuous and 9Vis,cjm= ©, ferecaci mets [t,2) 5 
f ol Yat) IvCays) is continuous in s, We have assumed that, for each 
S 


te [t,.4), { Y¥Ca,t)nla,s)da is continuous in s. Thus there is a possible 
s 


faeecentbinuity of Y(°,t) at any 


s € H(t) = (h(t): Lae DN 


at any 


s € H(t) (h(n (t)): jf eee 
at any 
S eH, (t) = (hj(h,(h(t))): Ae = Ley og iol See, 


Since h(t) < t-7y there are a finite number er discotb a iimanles On any erliraue 


Mitemval [t,t]. By (2.15) a discontinuity of Y{-°,t) ab s<t is piven by 
oa a ay 
(@. 15) eC Ste) ise) a Bs, (s),%) - ¥(h, (s)",t)Ja,(n) (s)). 


By Lema @.e, for t >s > tos 


t 
(Pag Y(s,t) = E+ 2) _ja,(t)¥(s,h,(t)) + Ff agl o(t,8) (5,8) 


tr 
fey ea do[ n(r, 8) J¥(s,@)dd. 
s s 
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Ww 
By assumption b) of Remark 2.1, f d[ v(t, 6) ¥(s, @) 1S COnUinuove 2 aaa 
S 


clearly the last term of (2.17) is continuous in +t. Hence, there is a pos- 
sible discontinuity of Y(s,-) at those t such that s €« H, (+) for some 


Meno, 1,2,5...}. Also, a discontinuity of Y(s,-) “at09e ees pace sem 
(2.18)  ¥(s,t) - ¥(s,t7) = YP _ja,(t)[¥(s,h,(t)) - Y(s,h,(t)7)]. 


Baga “and si in [t,,2), with t >s. Then Y(s,*) and “¥=5%) 
have the same possible points of discontinuity in [s,t]; order them 


t= 7) > aT > vee > = Ss.) [he dieconuinus vvecmarn (ra) mmcmels 


ue 
¥(%,¢) - (7, t) E. 


Mien) = ¥(«.,t) = - ea 
i iL (2: »1(1,) aay "0 
mets) = Y(7,.%) = ey [ -) JGayes 
2 2 { 2: ny (t) = tT) eae h(t) » T) Jeo > dk 
17 ~ mE Sue 
(#2 by (t>) = 1) 7 9 
¥(s,t) - ¥(s",t) = x r eee 


ma el ; 
ie: h (t,) = Ty a33 fae h, oe = Tq 0) 


aon aj(t,)]---}a,(t, 5) lat, 9) 


(ale ny’(t,) = TH) 


+ coon ee ie (Gs Ve 
{ 2: ny (74) = op pe 


The discontinuities in Y(s,*) are: 
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¥(s,7,) = ¥(s,7,) = 5. 


ME %qay) = Msg) * (2: nig : eS 
{js malta dete) deh) 
+ - nigel ; hee 
eat) a : ol saat soe ae 
o>, neg.) ; i ai 
bocce 4+ e a(%)- 


(ts h(t) = 7) 


By interchanging the order of Summation in one of the general expressions, 
we see that Y(s,t) - ¥(s,t) = ¥(s,t) - ¥(s',t), and so Y(s,t) = ¥(s*,t). 


t 
Remark 2.5. For the map s >f w(a)n(a,s)da to be continuous on [ ty.) 
S 


for each w BV([a),2),R) and + ¢[t,,a), it is sufficient that in addition 


mou 2.8), 


n(t,@) = o4(t)C(t,6) + Zed (t)xLe,(t)1(@) + T(t, 6) 


2 
where D,: [t,,4) +R is impegrablers, = 0 yn. .s.c- 
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Ae, (6))) OE Me 14. 6)}) R*. 


fees in remark 2.1; g, is continuous and strictly increasing on [t),@), 
a, < g(t) Ge tere ts [t,,), £= 1.22505 (%,°) ) is comcimuousmon [a,,@) 
femeatl t € [t,,2)- 

We now consider a set of conditions under which solutions exist 


within the class BV({),a),R). For the proof it is useful to note that 


OE _a,(#)x(m,(t)) - DP_a,(s)x(n,(s))| 


< UP sl ag(t)-a,(s) lx! + BP ahag(s)I | x(ag(t)) -x(a4(s) 1, 


max{t, s} 


where Noll = Su Ps Go iS Wot: 


Tac [O95 


= ye ei a (+ )x(h EAS Vaal, 2p ja] . var 2 


al? i ae 


Ct ‘ 


ye 
TL cert, yt mona (eat (ts) 1 


under suitable assumptions on the ap and Nps as below. 


emma 2.f. Assume (2.4), (2.5), (2.8), and there exists a A>O such that 
S(A) = 0. Let ty >A + A and Gre) =aiCt co) a VC GO) sbe as imaememaun 


Peeewiere in addition t <s implies h(t) < h (s), and a < h )(s) < s-A 


Lo= 1... Dene a, are of bounded variation on every 


bounded interval; and there exists L>0O _ such that 


. 


forall s ¢€ [t,»4) 








eal 


f a,|v(t,6) - v(s,0)| < i]t-s|. 
“0 


ime there exists in (ee Le) a solution to 


ate = Q, 
to t 
x(t) = P(t.) - J “d,fu(t,,6)]0(@) + J afu(t, 6) ]x(6) 
6 6 
Daas 
oF il d.fn(s,@)]x(@)ds on [t,, 7] 
en cts 


where 9 € BV([q,t 1,8), @ is right-continuous, and t) <T <a. 


O 
Watt. 
mae ror k = 1,2,3,... define Ces ae and the sequence of functions 
p(t), t € [Q,t +t] 
bo vain 
(2.19) x, (t) ={ (t,) - SJ “afu(t,,e)]o(e) +f “af u(t,@)]x,(6) 
% % 
t-T. Ss 
+f “*fa.n(s,e)]x(e)ds, t € (t.4t,T] 
ie Sayers A , Ok?” 
O O 


xy faerie —CONvLiInuous on [%, ttt, Since 0) Us, svepping OVer a heerycees 
of size 1,, the continuity of e(V¥,s) expressed in (2.4) and the right-con- 
tinuity of xX, on previous intervals yields that, so long as xy, exists on 


[%, TI, it is right-continuous. 


For te [t, totAl, Since amor A) r= O, 








Co 
eure 
a(t) <lloll + 20¢2-ap) loll + fn s)llay 2 
O 


panee the right-hand side is non-decreasing in t, 


t-T 
lll, $ C2 + 26(t-op) loll + J “n(s)[laq,l| as. - 
O 


By Gronwall's inequality, 


laagl,, $ (2 + 282-04) Ilo] expt / “n(s)ds). 
0 


Similarly, on [t +, tote, since the second part of (2.19) can be rewritten 


ty tA-T, va 
y(t) = mltotd)-J  Sglu(to*tye)]e,(8) + J Naglu(t, 6) Ix,(8) 
O O 


aun Ss 
+ f a do[n(s,@)}x,(@)ds st Ese, 
tytht, 0 


we have 


eee iB 4 Site x +f K ms a | (ely ee 
(Ol Slag * MEI aa LN ACO 


n(s)llx,l| as , 


ane 
ly, $02 + 20¢t-a) Tylon * J 
kK 


Uyth-t 
Gar 


k 


Eola sel + 2e(T a6) Madly an xe J _ m(s)ds} 


ia 
2 ar. 
< [1 + 2e(-0)}"Iollexo(f Sn(s)as) 
0 
pt 


Now, if Yo - 1 + greatest integer in I=", for all k we have by induetion 








2d 
YO Al, 

lap < C1 + 28T-a5)] “llellexp{f m(s)as} = B 
UG 


x? 


a uniform bound on the x,, as long as they exist over [Q,T]. 


For k > vp (so that t <A), we re-write (2.19), 
% p 
0 
t Bete S 
+ f df v(t, @) 1x, (6) + f f d.[n(s, 6) ]x,(@)ds, 
“6 Organ ao 
t¢ (to+t,, 7]. 
lina 
var xX, = var @. 
var Roem Vode OO \| x | »P var a 
k= ke Pea) L 
[Ot tA] [O%,t,] [t5,t tAl 
+ var aa sup Ja .(s)| 
[%, to] s<[tp, ttl 
UotAa-t, 
+ tdlxyla + 1° “a(s)llxfl as 
t 
0 
sé[ ty, totdl [a, to] 
t.+A-T 
+ i var a, +iLA+f : Kn( s)ds]B : 
h=l L X 
[ty, ty tAl to 


Re-writing (2.19) again, 








eh 


both ye 
x(t) = x(t, +d) - d fe(t +4, 8) x, (6) + 2)_)a,(t)x,(h(t)) 
t ; ane S 
+f do{ v(t, @) ]x, (8) + f J d,[n(s,@)]x,(@)as, 
07 


0 ty ta tO, 


te (t +A,T]. 


ihaus 


a are a ee > lh i var a 


k= k gal 
[Q),t, +24] [a,,t +4] [t +4, t +24] 


+ vor ae sup | a,(s)| 
[a,,ttAl se[ tot t ted] 


Ue er 
+ lle +L — “w(s)[lyl as 


t 
ge: 


ie a. Sup la (s)] 1 var @ 
se[t., t+] (Gp. 


tyteA- ty, 
(Eye Mer ay + Ls n(s)as)B, 


=| yy 
2 
ead A] bo 


E i 
=) sup Ja (s)] (C1 a 


g=1 =| eee Ja (s){ 1° 


se[ to td, tot2Al se te t +4] 


var 


C.+4-T 
+ a van a +I1A+ f 0 “n(s)ds]B } 
a [t,t tAl “ t 


< |b Da sup | a (s)| 1 var © 
set, ty 22d (ayia! 


+ [1+ aa sup |a,(s)| ele roe ay 
se[ ty, t tea (ty, t)+2Al 








22 


tyteA-t 
+ 2LA + f m(s)ds]B_. 
A 2 


0 


With the equation re-written to begin with x(t, 42d), we have 


var =x, <_ var : a lJ, i ie ay 
[Q),t #24) [%, t+ AJ [t+ A, t +34] 
+ var a sup |a(s)| 
ka L 
[at +2] set teA, $134 - 


ti to-7,. 
+ lx, + S m( s)[| x, lI as 
ty teA-T, 


<r he sup |e(s)1 1° var @ 
= se[ty, ty t2Al [a,,t5 

sup la (s)| [2° var a 
se[t,, ty +eAl x 4s) 


+ 
= 
4 
+ 

<a 


= 


tyteh-t 
OBA dsl m(s)dsjB, 
% 
t.+4+5A-T 
var By ch In do) 2 x 


£ 
[t ted, t 5134) tytea-T, 


+f m(s)ds]B, 


L=L 


+ Oi sup [a,(s)| (C2 + ae sup . 
se[t,t2A, t 134] se[ ty, ty tel 


| a ea qr var © 


[%; 7 


+[1 +4 i sup Ja,(s)1IE,_, var a 
sé[ ty, ty tel [t,t ted) 
tte, 
Fei eel m(s)ds]B_} 


"6 
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Shes 2g SUD ja,(s)1 1° var © 
s<[t5, t5134) [Ato] 
Hei chee, sup lee) pe var a 
Veal L VN L 
se[t,, to +34 [ to, ty #34] 
TA +3A-T 
+ 31A + f : Kn(s)ds]B 
ty - 
of ae sup }a (sj | {C+ aN sup | 2 ,(s)| ie var 
se[t,, t +34 sé[ ty, tot] [at] 
+ [1 + ee sup }a,(s){IEZ,_, var 2» 
sé[t,, tot A [t,t 194 
Mey eo 
Ea SAV” aa m/( s)ds]B,} 
ie 
= [1 + a sup ja,(s)1 1? var @ 
s<[t), t #34 [at] 
+ [1 + Be sup | a ,(s)| re. var a 
se[t,,t)t3d) [t,, tot) 
C43 A-T 
+ ZA + f e “n(s)ds]B_.. 
ie 
Continuing in this manner, for k > Yos 
“0 
var x eae sup Ja ,(s)] 1] var 
[o,, 7] se[t,,T] [a,,t5 
+ [1 + ae sup | & ( s) | OTe var a, 
“" s€t),T1 cae 


iT 
+ VoLA + ‘aa s)ds]B,. 
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AUS ise oe 1s uniformly bounded in k = v 


ig oes LOr el wee [t,, 7] 
[o.5] 


0? ‘o* 
for which x, (t) exists. But since each of the x, is of bounded variation, 


right-continuous, and bounded by a constant for as long as it exists on 


[%,T], the defining relation (2.19) shows that x. exists over all of 


k 


[a,,T] for k= Vor Yoti,--- - By Helly's theorem, there is a subsequence, 


0 
which we shall also denote by x,, and an x ¢ BV([a,,T],R) such that 


x, (t) >x(t) as ko, for all te [a ,T]. 


By the Dominated Convergence Theorem, and the facts that 


« 


+ 
u 


if d | u(t, 8) -0 as ko, and 
a 
k 
t 
f m(s)ds >0 as ko, we have that, for te [t),T], 
t-T 
k 
t-T t 
f “ao(u( +, 0) 1x,(6) ~f d[u(t,e)]x(e) as k-»«, ana 
% “0 
a Ss Coees 
) f d[n(s,@)]x,(@)ds >f f do[n(s,@)]x(@)ds : 
G 
oe % OQ O 
as kK->o, Thus 
(t), te [a ,t] 
ve G 
oe (ey er P(t.) - J “dfu(t ,6)]o(e) + f dal u(t, &) )x(@) 
a, 0 a, 


Gos 
(Ft! SF aln(s,e)Ix(e)das, t € [t,2], 
to Qo 


and x is the desired solution. 
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4. Quasiconvex Families of Functions 


We now present definitions and resulting properties which will form 


the basis of the proof of the necessary conditions. Let 


Le= [o,, 2) be a bounded interval containing [ast], 


i el (to, a), 
G vea fixed, open, convex region in Res (possibly all of R"), 


F pea family of functions F: C(I,Y) x I' >R", 


Pe iene Ros a >0 sieve) SN a i lols! yo =U, k any 


positive integer. 


Deitaiyion 4.1. For compact EAMG De ly non-negative K é€ Gd). 
rae 7, let 


CL, X)y « = {x € C(I,X): |S- D(x(*),t)| < NGG) Maaco outer 


x, € we 


0 
Definition 3.2. A family # shall be called quasi-convex if: 


a) Each F(x(°),t) ¢ # is oe Ile) O87 4 siione adil dato | ae tS AE ile. 
Deesuraple On If for fixed x é Gee le 

b) Given any Fe # and any SOM Pde Ue nCOnvicn se SAe theresextsus 
m € 1, (tee [m depending on X,F] so that, for all t¢I' and x eé Cll. as 
[F(x(+),t)| <m(t) and |[aF[x(+),t; -]] <m(t) [i.e | aF[x(-),t;¥]| < 
m(+)|| vil, for ye¢C(I,R )], where dF is the Frechet differential of F with 
respect to x. 


c) For every compact, convex X contained in 4Y, compact ¥C 








a9 


C([a),t,],X); non-negative K ¢€ Gos 8) finite collection (F,,200,F,} C Ze 
moe > O08 Lhere exists for each Be pS an ae e F, LF, depending on 
fae, the F,, and €], satisfying 


ied ie val 


Kk ° | °° 
}Fa(x(*),t)] <2e_jmi(t), Harlx(*), tse < Ee ym, (+) 
momeeach B € os t ¢€ I', and x € C(I,X) [where the m, are be (IR) 


functions described in »), depending on X and the F. J, so that 


G(x(*),t38) = DEB F (x(+),t) - Fa(x(+),t) 
satisfies 


(ct) {ff “o(x(°) ,t3B)at| <& for all Be Eo [t,,%>] CI', and 
45 
iL 


x € C(I,X)y fe 
e 


(Gos) ir (eons is a sequence in pk so that 6B, =e rae 
12.0) = 
then (G(x(*),t5B;)}5_5 converges in measure on I* to G(x(°),t3B) for 


each x € C(I,X)y xe 
3 


Remark 3,1. By the definition of G(x(*+),t3B), 


|c(x(+),+38)| <2 De_jm,(t) and 





act x(-), 385+] < 2 Ze_jm,(t) 


momrat) x € C(I,X), Be 3 and te I't, 


: Kaa 
Pemarx 3.c. If # is convex, then it is also quasiconvex, with Fa = ele 





Oe = = 





0 


n 
Meona 3.1. Let XCR,Y¥C C({a,,t,1,X), K € T(E Assume K>0O, X and 


meecompact, (2.5) - (2.5), and 


Mmepees there exists \} >0, L>0O “Such that, an se) ae 


=—s 


t 


“f [d.fu(t,e) - n(s,@)]| < 1 t-sl. 
t-x 


then C(I,X)y K ise Compact supseu on Ce eia)e Tf X and ¥ are lconve 
P| 


CL, X)y x is convex. 


Proof: Convexity follows from convexity of ¥Y and K and linearity of D. 


C{I,X) is bounded, since X is compact. Let x é¢ C(I, X)y x: Then 
= I 


|x(t)-(ty)] < [D(x(+),t) - D(x(+),t0) 
+ Je((+),t)-e(x 4%)! + Jel, ot)-e(%, 4%) | 
t 
Sf K(s)as +1 aglutt,2)I€2(2)-x(¢9)1 


O 6) 


+]e(xq 9%) “8%, st) I 


eiegse sy, O< y< A, such that Oy) <1. Let b= [1-8 YI]. Then if 


Ge € [to totrl, 


| x(t) -x(t,)| = Of lena le u Jel, t)-eC4, 3%) 
t 
+ f K(s)ds 
70 
< 5( Moxy I + Sup la(¥,t)-g(¥,t )| 


te[ Los torr] 


ye ¥ 








pt 


i 
+f K(s)ds. 
% 


pinece the right hand side is non-decreasing in lt, 


IIx-x, |], < 8&(yllx-x, ll, + sup —_[ a ¥, t)-e(¥,t,)| 
ey i heel! 0 
O70 
ye ¥ 
t 
+ f K(s)ds. 
% 
t 
|x-x, le <b sup le(¥,t)-e(¥,t,)| + bf K(s)ds. 
0 te[t,, tot] to 
ve ¥ 


The supremum is finite since g is continuous and the supremum is taken over 


a compact set. For to) S Ct as ttt, 


a(n] 1D), 2)-DOC D279] + Lely, s8-al, 2) 
t 
+ IJ dof u(t,6)-u(t", 6) IL x(@)-x(t,) ]| 
O 
t 
| Waele =) ets | e(y,t)-a(¥,t")| 
Ge wel 
as 
+ bL{t-t'|[ sup | a(¥,t)-2e(¥,t,)| + f K(s)ds}. 
te[ ty, torr] to 
ye Y¥ 


By the continuity of g and compactness of Y, the elements of C(1,X)y K 
3 

are equicontinuous on [o),t +r]. By the Arzela-Ascoli theorem, C(I, X)y K 
: 2 


Restricted to [a ,% +7] is contained in compact ¥, © Clo, ,t +r] ,X)- 


e 
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By the same arguments, we show that C(I,X) is equicontinuous, 


aK 


and hence conditionally compact, when its elements are restricted to 
| a-t 
° Ne m O 
[o,t #29]; [Ot #39], --- [&%,t Wr], where N = greatest integer in gers 


Then, as before, we obtain equicontinuity on the interval [o,2), (noting 
that g is defined for t = a, and including this value in the supremums). 
By { 8, theorem mye 5) C(I, X)y K is conditionally compact. 

3 


= . 


Let xt ¢ C(I,X)y Kw j =e)... xJ +x as jo yo Cee @meels 
I 


J 


compact, x € C(I,X). Y compact and x € ¥, jg = 1,2,-.. imply that 
0 


x, € ¥, E p(x4(+),t)| < K(t), j = 1,2,..., @.6.) Beal and se Omecnr 

0 

tinuous imply that |S- D(x(+),t)| < K(t)> a:6.5 Sorel ee uiinnc amc C(I, X)y re 
3 


SO CI, X)y x is closed, hence compact. 


Remark 3.3. As an example of a p(t,@) which satisfies (3.1), let 
_ yP 
w(t, 0) = X47 _,a,(t)xX[h,(t)1(@) + v(t,@) 


mmiieremoark 2,1, In addition, assume that there exist 7A >0, L>0O sueH 


that 


i) a, S h ,(s) <s-\, 22> 1a ce [t,.2); 


t 
mayer t <s<t<a, { d,\ V(t5e) viene ete 
— cope 7 


Then clearly (3.1) is satisfied. 


Lemma 3.2. Assume the conditions of lemma 3.1 hold, and ¢ >0O. Let 
Bi(x(+),t), j =1,...,k, be mappings from C(I,X) x I' into R which are 
IE 


measurable in t for fixed x, and © in x for fixed t. Assume there 


exists me L*(I',R) such that 








D5 


JFiGC+),t)] <m(t), iar fx(+),t3-Il < m(t) 


eee (x €- Cll, X),0t € I! jie ek ew p(t), j = Lye. ke bewsieren 
non-negative, real valued, measurable functions satisfying D 1P,(*) = i eaees 
cieet*, Then it is possible to subdivide £' into sufficiently small dis— 

+ 


es : + : 
joint: sub-intervals I., lae- 1, - 2,...,) and to assign to each I. One ow 


wae functions F eee atys which we shall denote by F so that the function 


1 1 
al 
given by P(x(*),t) = F, (x(+),t) for ted,, i = #1, = 252 and 
ab 


Pewe.1,X), satisfies 


Tv 
JJ (Zep (tyr, (x(+),+) - FOx(+),t)}at] <e 
o 


hommevery tT 


t 
yet2 in It and xe AL X)y x 


Proof; The proof follows that given by Gamkrelidze [10; lemma 4.1] where one 
takes the compact set CI, X)y as the domain of the Fi(+,t). Actually, 
Pomteeeis made of the fact that one function mé Ce) bounds 2 lik os 
the functions das the proof is valid if the bounding funetion depends on the 
ae as in the definition of quasi-convexity. 


tet YW CR, Ue I? + subsets of W. Define 
os (ue ue Measurable Ole lt smi cy) teem aon menue et ayes 


Consider the controlled system 
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ae D(x(-),t) = £(x(-), u(t), t)) axe 


where © C ClO, to], SF), Ke CCL) pete gen 


Lemma 3.5. Assume (2.3)-(2.5), (3.1), f defined on C(1,¥) x 2 xI', each 


ee: as :; 
a is C in x, Borel-measurable in (u,t). Also, given compact Cee 


and ué%9, there exists m€ L'(I",R) such that |/t(x(-) ue), c)le ae 





afl x(-),u(t),t;-J]] < m(t) for each t € I', x € C( Te whereu diam ecm 


me-cver differential of f with respect to x. Then the family 
= {F(x(9),¢) 2 F(x(= et) =f x(2 ue), ce tor come mena), 


is quasi-convex. 


Proof: The assumptions yield a) and b) of the definition immediately. For 
part c), we use lemma 3.2, Since at each time t, Fa(x(+), t) # Fi(x(-),t), 


fpeeeoemon {)....,k}, clearly 





Jea(x(+),t)1 < Zeam(t), larglx(-),t3-IIl < Ze ym, (t). 


fe") is the conclusion of lemma 3.2. In the proof of lemma 3.2, I' is 


divided into sub-intervals I in a manner independent of the multipliers 


p(t). Thus the I may be taken as fixed, once given Poseees FL, and €., 
t t ; ae 1 = 
Let the Ti (the subset of I), on which Pe =F, fea 


i p,(t)dt) be taken in order in i so that they vary continuously with 
t 


B= (Dyy+++,)Py)- Then by the measurable bounds on Pe, and the F,, and the 


Semivavion of G(x(-),t;B), (c") holds. 








oy) 


We now set up the main theorem to be used in proving necessary con- 
ditions. Let 7 = [O%, t, | ee iF uy >t, 7 a quasi-convex family, and 
o C C([a,t,1,F). For D satisfying (2.5)-(2.5), define 


fe. 2) Geo ts = Cae Eo e 0, = Des pty = dod >) i) 


a.e,,500 7 ' = [t,,t,] for some f e Ff}. 
Assume z2¢€ C(¥,¥) satisfies 
(oD) sz D(2(-),t) = f(s epee cemon 22 
f* a fixed element of ¥Y, and 
(5.4) z = Ey 


taeeeceiaxed Clement of ©. Clearly, 2 ¢€ Q(t,). We denote vie clench gaser 
o-p* by 6&9, and the elements of [#]-f* by Sf, where [¥] is the convex 
hull of 4% Let PW be the maximal convex set such that oo 8 C4 %e@ @ 

Dye is a convex set containing the zero function. 

By a) and b) of the defination of duasi-convex families, there exisus 
an mn X n-matrix valued function 7*(t,@) representing the Frechet differential 
Beep ae ),t3-)], so that (2.7), (2.8) are satisfied. This 1* will be fixed 
for the rest of the discussion. Let Y(s,t) be the matrix-valued function 
described by (2.9)-(2.11) for n = *. For each & ¢ P-p* and Sf « [F]-Ff*, 


define 6&x(-;&,5f) ¢ C(_F,R") by 
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5) &x(t3%, Sf) = ¥(t,,t)D( &,t)) 
to i 
+f a f-S a [¥(a,t)]u(a,o) 
= 0 % 
t 
+ f Y¥(a,t)n*(a, oc) da} &(c) 
. 
0 
ie 
sae es (6) kere FAG) «Ca Yole: 
t 
0 
nepeall t ee? ty and 
(3.6) Sx, (+3 8p, Sf) = Sp.. 


0 


Now we define -& Cc(_¥,R") dy 
©. 1) M = { Sx(°s &p, Sf). Oo € Pox, Cie Le Wanted 6 


Since (3.5) is linear in & and 8f, and both P _ox and [#]-f* are con- 


hex, if Ox. = Sx( +5 Sp. , of, ) é AM i = Leen hs UMC h@l mm tc p 


iH 


ie 1 r i 
YP ox, = 2,_,B Sx(-3 8, , 6f,) 


ie. 8) 


Sx(+52)_ 18° 8,, Ly_.B8f,) 


Min 4, Thus -€ is convex. 


Theorem 3.1. Given the assumptions above, D also satisfies (3.1), and a 
finite set A = (Sx, , 00,5 } Gs then for every WV = ©) ange « (Or 


there exists €', 0 <€' < ¢, and a continuous map @3P -> Q(t,) such that 








oT 





lier - iB &x,l| <v for all 6 = (B'j+++,8") € 


(Both @ and €' depend on A, v, and €). 


mroot, By the definition of Me there exist Sf. « [(#¥]-f* and &. e # x, 
Shataated af x 


i= 1,...,r, such that 6x, = Sx( +3 Gp. , of. ) for cache a= wli..ie Geeoaae 


there exist oe or e F, (Qapors bs) € ee ie lip Soke 18 glee Of = 


J ig 
epst,-f*, Le ee gt Ol CAC ae ae eee 


(3.9) SSP) ae 2, Beh &)( +58) a Ne Meo: and 


18 IL 
Soo) Karke meee 


Men, tor all Be Ee 
ve veg 
.10) f* + €Sf(°,°3B) = (1-8)£* + Ue 5 £8 BS) £56 
Since (1-€) + ee Ds eptp? = 1, we have that f* + €8f(°,°38) ¢ [7], for 
ey eye Ie 2°5 , 


a FO, 1] and B e cae From (ps5) (2.6)5 (3.8), (309), and theorem eo 


foreach Be P and t Gur Be 


t 
(3-11) Sx(t38) = 8(t 38) - f “dglu(t,,6) 1&9(esB) 
% 
t t 
+ f do[u(t,@) ]5x(@5B) fool Cnt vai 9) p vond Oe julie 
% 7 
: 


+ f 8f(z(°),s3B)ds. 
6 
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Let X be a compact, convex, subset of ¥, so that z(t) is an 
maigerior point of xX for every t e #, Such a set exists because the closed 
convex hull of {z2(t)s: t ¢_A%} is a compact subset of the open convex set 
WER. F quasi-convex implies that there exist functions = S L(_¥*,R), 


(3.12) [e*(v,t)| <mo(t), llae*ty,ts- 





Il < (+) 
15) J£5(¥,t)| <mj(t), lat jfv,ts-l sm(t), g = 1,..-54 
Meee (Yt) ¢ C(_Y7,xX) x7%'. From (3.9), (3.12), (3.13), 


(3.14) | 8e(v,t56)| = [2p_, Lye eee(v.t) - Ue e#(v,t)| 


< aa 7 _6 "Bilt, (y,t)| + | f*(y¥,t)| 


— 
= 


< Eom, (t) 


for all Be P, (¥,t) ¢ C(¥,x) x_¥'. Similarly, 





.15) aC S£)[V,t5B3° -om.(t) for all 8 « Pt, (W,t) € C( F,x)x. 


Now let € € (0,1), K(t) = oF ot m.(t) for t¢%', and W = con- 


vex hull of (9*,9,,00:,9,}, where 9, = &, +9* « FP, By the Arzela-Ascoli 
theorem, ¥ is compacte From (3.10) and the definition of a quasi-convex 
family, there exist functions F(+,°3B,€) ¢ #, defined for each B ¢ P 


? 


satisfying 
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i. 16) |F(y,0385€)| < K(G)5 [leh see een 


for all (v,t) € C(_¥,X) x #', Be P, & € (0,1), Such that if 


2 
ie. 17) © f(*,°56,¢) = Fl, °*se.ae= (ie Cont apap 
then 
ae 2 
(3.18) Ef O f(x(>) eee eats for au on eee 
oO 


BeP,xe CCF ,X)y 7 


and 

(3.19) lim 8° £(x(*),t381,€) = 8°£(x(*°),t38,€) 
pS 
Bt ¢ pr 


in measure as a function of t over #%', for each 6 «€ je. Cre 1@ lela, 


K€ C(F,X)y x° From (309), (3617), (no) 


lim F(x(*),t3B",€) = F(x(*),t3B,€) 
B' 8 


pee pe 


in measure as a function of t over Wt, for each B «€ Be ee (Ov): 


cm CF ,X)y xe ‘Thus, by (3.16) and the Lebesgue Dominated Convergence Theorem, 


(3.20) lim | J*Lr(x(*),738,8) - F(x(*),738",€) Jaz] = 0 
' +8 17a 


Bioe p 








LO 


uniformly with respect to t ¢¥%', for all B « me , a oe (OO oe Xe Cer K° 
es 


We now consider the perturbed equation 


(3-21) Se D(x(°),t) = F(x(°),38,€) 


2 
£*(x(°),t) + €5f(x(°),t5B) + 6 £(x(°) ,t5B,€) 
fees on _', with initial conditions 


5.22) ee ae &&p(°sB) = o* + &&p(>sB). 
O O 
eee *38,€) be the solution of (3.21), (3.22)$ then from (3.3), (3-4), for 


each t¢-¥' where x(t38,€) is defined, 


t 
(3.23) x(t3B,€) - 2(t) =f agfult,e)1tx(038,€) - 2(8)] 
o4 
0 
+ D(E&( +38) ,t9) 


iG 
Bi StG@ OSB .2) sees 
17 


@ 
+ f [£*(x(+38,€),5) - £*(2(+),s) ]ds 
t 
0 
ee 
+) |  Ort(x(e36 6), se 6 )ds. 
% 


We will show there exists TT Pr OmeouCh Ena. hor alle ac (0,€,], hdc) js) ie PE, 
mit.p,€) is defined on F and takes values in Y. This, together with (3.21) 
and (3.22), implies that x(°3B,€&) ¢é Q(t,) ope Bu Ae, ee (0,€,]- We 


mw2ll also show 








21, 


(3.2) tim 2CC3B2E)=2 _ yr pis co 
€ abe eae 


fortormly with respect to 86 «€ 2. and 


(3.25) Hat avamee deo ced fs) oe x(°3B,€)|l, = (0) 
Bt — 8 iL 


Bt ¢€ Pp 
meeeell] BeP,é&e (0,€,]- Thus, given v>0O, choosing €' ¢€ (0,€,] n 


(0,€) appropriately small and setting (8) = x(°38,&'), we have that 


©(8) is a continuous map of Pp’ into Q(t satisfying 


D 
Pe . 
(epee - Ys 28" 8x, | =<). 


as in the theorem statement. 

First, we show that there exists fy > 0 Sucheyast it Oo <7 <&,; 
then x(tsB,€) is defined and in Y for all te %, Be Pp. 

Let Z = {z(t)s t ¢€Y}, so Z is a compact subset of Y. Also, 
Bethe definition of X, Z is in the interior of XC Y. Choose ~>0 


Mienthat, for & as in (2.5), 0 <1-8y) <1. Let 





Pia 
k = [greatest integer in = } + 1, 
-1 

bs [1-8 ¥)] ; 

= 2 Olan ae 
ees | 1h ab Zl 1 a) Ib, 

ie 

Cs yl oP, ws 








moose c>bdb_ such that 








yo 


18 
sup a exp{(b-c)f m(s)ds} <1. 
te(t +7, %,] t-¥ 
Let 
= a oF 
0 = [kb + aq + bf a m.(s)dslexp{cf “m(s)ds}, 
ts, ees + 0 
O 


and Py >0QO the distance between Z and the complement of xX. If 


5.20) 25 = min{l, p, /20), 


then, from (3.22) and the above choice of constants, for t « [% st], eG P, 


and € «€ (0,€,], 
| x(%56,€)-2(t)| < p,/2- 


Thus x(te6,€) is defined and belongs to X for every BeP,€&€ (0,€,], 
and teé [Q stole Assume that, for some 6 e oa gre (0,€,], che Ssoluvton sen 


Howell), (5.22) either fails to exist on all of # , or else leaves X. Let 
tT = sup{t' ¢« W's x(tsB,&) defined and in X for all t+ eé [O,t' ]}- 


Denote [a,t] by Fo: [t,t] by F bh Thus x(t3B,€) € X for all 
t¢ i Bac from o. 10) aoe a1) 
\d 
{ 


are DiC Greyeyeo) a K(t) aoe. on Fh 


By (3.18) and the definition of Y¥, for all +t cP i, 


me. 
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i a x 
| f fo) f( x( 256 Cleeencpdc a ° 
t 

O 


Memes. 12), (5.14), and (3.25), for all, £ Ses 


. | 
(3-27) | x(t5B,€)-z(t)| <|f a,fu(t,@)I[x(658,€)-2(e)}| 
O 
O 


t 
+ [D(ES(+36),%))] +E f Ui_om(s)as 
| O 


t 
—-— —2 
+ f m(s)|[x(+3B,€)-zl| as + € 
% 


t | 
< | J agfu(t,@) I[x( 658 ,€)-2(¢) II 
%0 


te : _ 
+ [14 f Ya,u(t,o)| leap 3B) | 
CF 
O 
t 


— —2 
+ € ya mol Sies +e 
J J =O i ) 


O 


its 
+ J m(s)|lx(+3B,€)-zll ds. 
%o 


By induction we will show that, for every % Se 
°° x(°3B,2)-2]], <& 6 


mor +t e¢ [t,t +r], Dy ewes) 


P 
f ag w(t,@) Itx( 38,8) -2(0)] = 
% 








yh 


by _ 
=f Pagtn( t,o) Mee 058) 
Gg : 
O 
t — aw 
=; if dofu(t,@) I{x(05B,€)-2(6)], 
% 


and so 


, 
IJ dgfu(t,6) ILx(05B,€)-2(@) I] < (t+, -cp)ll€8p(. 5B)I| 
0 





+ & y)llx(°5B,E) -2ll, « 


Bence, from (5.2/), for te [to,totr], 


|x(t5B,€)-2(t)| < &t,-a, JIE a(+58)I1 + 8 y)Ilx(°5B,€)-zll, 
+ [1 + &t,-0,) MES(+sB)|] + E 
in a 420, (s) ds + J m(s)ilx(*3B,€)-zl| ds. 


Since [1 + 28(t,-a)] >1, KCc Bey a=c(t)s= COO tee) tone ure [a,,t,], and the 


right-hand side is non-decreasing in t, this may be rewritten 


18 
Ix(+5B,€)-zi|, <[1 + 28(t,-a,) il€sp(+5B)l| + € J Ei 0 (s)ds 
O 


iy 
—c = 
+B 4 fm (s)llx( 38,2) -2l] .2s 
a5 


+ 8 y)Ix(°3B,&)-zil,, t+ € [ty,t +r] 
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Subtracting &( y)[lx(°3B,€)-zll, from both sides and using the definitions of 


the constants, 


t 
aoe me ae eae = 
(+ 5B,8)-2l|, < ve” + allSp(-5€)|| + ve J Xe om. (s)as 
; ie 
O 


—-~ oa 


© 
+ bj m(s)||x(*56,€)-zl| 4s, Pec [tostytr]- 
“O 


t 
Gronwall's inequality states that if y(t) < A(t) + f u(s)y(s)ds, X>0, np >0, 
a 


t t 

then y(t) < Mt) + J AMs)u(s)exp{f u(é)dé}ds. If 2% is absolutely con- 
a s 

tinuous and non-decreasing, we may integrate by parts, obtaining 


t t 
y(t) < A(t) - As)exp{f w()GE}| 
Ss 


eo t 
+ f Ms)exp{f n(&)dé}ds. 


a S 


Since w >O and i >0 almost everywhere, 


t t t. 
y(t) < Ma)exp{f u(é)dé} + exp{f u(é)dé}f A(s)ds, 
a el. a 


t 
so y(t) < A(t)exp{y w(é)dé)}. 
a 


Meine this modified Gronwall's inequality, 


(3.29) Ix(*5B,8)-zl], < [be + alloep(-35)| 


t t 
+ aia es a 
O 








Now we make the induction assumption that, for t € [tot ytky] CF), 
mo | an integer, 


x(+3B,€)-2l|, < [eee + all&Sp(-58)|| 


t t 
+ be f ms m.(s)dslexpte/ moCsids}< 
; Jno O 
0 
O 
Bet te [totky,t)+(k+1) y]- At first we assume a solution x(s3B,€)-2(s) 
Bie 2nitial function Xa (*5B,€)-2, _\ at initial time t-y. Reasoning as 


before, a form such as (3.29) clearly applies, so 


I x(+3B,8)-2ll, < [bE + allx(+3B,E)-zll,_ 


t t 
‘ LP sacits(s)Aslexplb og 


Using the induction assumption, 


l<(°5B,E)-2ll, < [be + alee + allEan(-58)| 


t-¥ tay 
+ be f Le m.(s)ds}exp{e f m(s)ds} 
O 
t 
es) | re m.(s)dsjexp{o f m.(s)ds}. 
t J ° 


=O 
ao t-7 


my the choice of c, for te Lt tky, to + (k+l) y], 


x(°3B,E)-2ll, < [(s+1)vE~ + allESp(+3B)| 


Iv its 
ae 25 oM4( 8) 4s] explc f m,(s)ds}- 
vo 7a 








Thus, by induction and the choice of k, @, and p, for t 2 


t t 
Ix(*5B,€)-zll, <E[kb + aQ+b 1 "EF gity( 8) ds] explc J “ito s) as} 


O O 


mach is (3-28). From (3.26), |x(t38,€)-z(t)| < p,/2 for all te F 3 in 
Perticular x(138,&) « interior X. Combining (4.16), (4.21), (3.22), 
K(°38,€) « CFOs X)y xs which by lemma 3.1 is compact. Hence theorem 2.3 
implies x(°38,€) can be continued beyond t. Since x(138,€) é interior X, 
Bars contradicts the definition of T. ; 

We conclude that there exists os e (0,1), given by (3.26), such 
that x(t$B,€&) is defined and takes values in X for all t ¢ _¥, whenever 


Be P, Ge (0,€,]- By the same arguments, with 6 replaced by arbitrary 


B ¢ Ee . € by arbitrary € e (0,€,], we conclude that for all t « ¥,BePrF, 


eB < (0,€,], 

jm .30) |x(tsB,€)-2(t)] <e p< ay 
and so 

f>51) x(°3B,€) ¢ OF ;X)y x: 


We now prove (3.24). From (3.23), whenever t¢ BW, Be 2 


Bc (0,€,], 
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, 16 
x(t5B,€)-2(¢) =f a,{n(t,6) I£x(058,€)-2(9)] 


<2) & is 
O 


: 
+ D(Sp(.38),t.) + | arrears re 2 cis 
1 
O 


BSG Px(x(°5B,€), s) - f*(2(+),s)]ds 


ae 


as : f 8° £(x(°38,€),538,€)ds 
t 
O 
1 t 
=e J aglu(t,6) I[x(03B,€)-2(@)] + D( &(+38),t,) 
ef 


0 


ct 


+ f Sf(z(°),s3B)ds + A(t3B,€) 
1 
0 

ts ae dip 2s) ssx(e3e cvaz(e ids, 
Xo 


where 


‘ 
M+t3B,€) = J [Sf(x(°58,€),858) - Sf(2(*),s56)]ds 
t 


O 


gi (£*(x(*5B,€),s) - £*(2(+),s) 
ite 

0 

- af*[ 2(*°),83x(°38,€)-2(+) Ids 


ease £(x(+3B,€) , s38,€)ds. 
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Meee (5215), (3.18), (3.30), and (3.31), 





hg 


t 
|a(tsB,€)| < f Zi_om,(s)llx(+58,€)-2ll .as 
ize | 


5, He 
+ f ee ate CU (121) . steal Fa) 5 
% 


= sbRdevd(C yertiead( 2h/s-S ina 2) ]||/ cle +e 


t 
<0] leurs ot m.(s)ds] 
;  Jn0 J 
O 


t 
+ f : = | £*(x(-38,£),5) a BZ) 15) 
%9 


- df¥[z(°),s3x(°3B,€)-z(°)]| ds. 


We note that the entire segment in C(Y¥,¥) joining x, (°5B,€) and 2, 


fies in C(La,,%],X) forall teF,peP,€€ (0,€,]- Also, f* « a 
and so is eo in x. Thus, by (3.30) and the definition of the Frechet 


Herivative, 


lim | =(£*(x(©38,€),8)-£*(2(+) 8) -d£*[ 2(°) ,85x(+58,€)-2( +) 1) 
a O° 
: ~ 1 
stot p° x °3B,€ -Z 2 a Cee is) tz) 
SSE Ao) ip igs ied) |) 


=Q0O uniformly with respect to 6B ¢« P for all s «_F'. 


Mom (5.12) and (3.30), 





20 


al £*(x(+3B,€) 55) a0 EACZ0) es) dtAT aC Ss ee ace 





<5 ( sup _||d£*[&x(+5B8,€) + (1-&)2(*),s3¢] 
E<[0,1] 


+ |ldf*[z(*),s3°] 





[$lx(+5B,€)-zi 
< gz (2mp(s)}ee = 26m4(s). 
-€ O O 
By these estimates and the Lebesgue Dominated Convergence theoren, 


lim (t3B,€) = © uniformly with respect to t «¥', pe P’. 
gE +0 


Let 


ME) = max PxGcsere) ie 
Ces) = ese ae ‘ 


note that lim (e) =0. If 
+ 
£0 


GES ) ae 6 SS emt) = Ui ae 8x, (t), 


men by (5.9), (3.11), and (3.32) 


i 
a(t5B,€) = J dolu(t,6) al 5B ,€) 3 INI S ), 
(es 


O 
t 


+ f df*[z(-),s5a(°3B,€) lds. 
% 
By (59) and (3-22), a, (°3B,€) =O. Again choosing y >0O so that 
0 


0 < 1-3(y) <1, and setting b = Pee 5A) Ie Sande Usilts | oeeleyne a One 





Be 7 





oH 
t € LtystytVs 


. ‘ 
laCtsB.€)] < S&yila(es6.e), + Me) + J m(s)lla(+36,€)I] ds. 
0 


Proceeding as in the proof of (3.28), we combine terms and apply Gronwall's 


inequality to obtain 


=e t 
lla(*sB,€)I|, < bA(é) exp{b J m(s)ds}, Gre [to torr]: 
O 


Bor an initial time Go > ty and +t ¢ [o,o+y], 


m Ww 
+ ME) + J m(s)ila(+56,€)I] ase 
0 


t 
llaC+sB,€)I, < [b€1+8(t,-o) Hat +sB,€)II Hae een m,(s)ds}- 


Choosing k as before and ec >b_ so that 
t 
sup b[1+8&(t_-a@.) ]exp{(b-c)f m(s)ds} <1, 
16) O 
te[tot+y,t,] t-¥7 


Sie storm after the induction step is that for all t « [t,,t,], Be ae 


€ € (0,€,], 


t 
la(+sB,€)I, < RoRME)exple [ “my(s)ds}. 
t 
O 


Thus lim laC?sB,2)I, = 0 uniformly with respect to 6B € P’, which is (3.2). 
sO I. 





De 


We complete the theorem proof by showing that (3.25) holds; since 
e ¢ (0,€,] is fixed in the remainder of the proof, we drop it as an argument 
in x(t3B,€) and F(x(°),t3B,€). Fix BeP. It follows from (3.21), 


(3.22) that for all Ble P, te", 


t 

(3-53) | x(t38)-x(+58")| < |S a,fu(t,6) IL x(65B)-x(9,8")]| 
O 
O 


+ |D(2;_,(8°-8'") &, , tp) | 


t 

+ | f (F(x(°3B),83B)-F(x(°36"), 558") Jds| 
fc 
0 


t 

< At38") + |S a[u(t,6) I[x(038)-x(,8') }| 
Of 
0 


: 
+ f | F(x(-58),8;8") - F(x(-38"), 558") | ds 
% 


Pm@ere, for a= x. | 8,1. 


NtsB') =a Er {8°-6t "| [1+8(t,-07,) 1 


HI [F(x(+3B),538) - F(x( +58), 838") 1ds| « 
% 


It follows from (3.20) and (3.31) that, if we set ACB") = pee WGtgsr } 
Ce=7* 
for all Bt'e«P, then lim AB") =O. By (3016) and (3.33), for t ¢F', 
Se 
Bt ene 


t 

| x(t38)-x(t38")] < A(B') + 1S 4a,fu(t,e) ILx( 058) -x( 656") ]| 
Cc 
0 


. 
o7 K(t)I|x(°3B)-x( ° 58? )|| ds 
0 








Bmoosing y and b as before, for t« [tp »totr] 


t 
|S dofu(t,@) If (658) -x(656") I] < 8(t,-c,)I1 &p(+sB)- 8-36") 
a 
fe 
+ 8 r)Ilx(+58)-x( +58" Il. 


i 
lx(*58)-x(+s6")Il, < 2b") + of K(s)||x(+36)-x( +56") || ds. 
0 
m 1g 
Ix(*58)-x(°38" Il, < 2oA(B" ) exp J K(s)ds}. 
0 


Choosing k as before, and ¢ >b_ so that 


c 
sup bO(t-a)) exp((b-c) J K(s)ds} <1, 
te[t ty, ty] o-Y 


we obtain by induction that, for t ¢ #', 


ce t 
Ix(-58)-¢ +58", < (H+) Mp" Jexple f “K(s)ds}. 
O 


Thus lim Se) (em) = 0, which is (3.25), and the proof is complete. 
B' +B te 


BoP 








5h 
4, Necessary Conditions 


We first formulate a control problem wich terminal manifold in R. 


Let ae be given real valued, ct TUney Lome, del imcd som 


ane: 
C(fa,t 1,4) x¥ x [t,.2), 7% be a quasi-convex family, ¢ C c([a,,t 1,4), 


ole 


peeen(x(-),t) satisfy (2.3)-(2.5) and (5.1). Define 
ert eat) re tare [t5.a), x € Q(t)} 


where Q(t) is given by (3.2). Let the functions 3 Sf SR = =o me 


be given by ~,(x,t,) =: Peas ELSE 


Problem 4.1: We wish to find (z,t*) «e& such that 


a) ® ; ( Z,t*) 


LA 


OM Or: ple] ) Ul eee e 


1D) ME ei) (0) boy n at Ih Gr iil 


) 9 (2.%*) S O9(%, +3) for all (x,t,) ¢ which satisfy a) and b). 
For such a (z,t*), let *, f*, and Y be given by (3.3), (3.4), 


and the remarks after (3.4). 


Theorem 4.1. Given the assumptions above, let (z,t*) be a solution of 
problem 4.1 such that 2(t*) exists and either 6 ={m*} or * € interior 9. 
Then there exists a row n-vector valued function defined on [t5.~) > and 


aL s t 
meee numbers @, i = -y,...,m, such that 


i) a < OIG ak ls a =O forall ie (sliy..2.5-H} sucae giak 


i 
@.(z,t*) <0, vi a ayl o Se 


ii) is given by 








22 


(4.1) ¥(s) ee 


alae 
ue aL. [Z, »Z t*), tesO, Wieser carol 
O 


where dh, bs une lrechey die rercmiualson L., and satisfies 


i .2) V(s) noe 

(4.3) W(t*) = Teo abl 249 2( 68), 14305801, 

(4.4) W(t*)2(t*) = Thay aby ey 4 2( 4) 16450, 0, LI, 

(4.5) CS) = VGte meee df ¥Co) In(a, s) ~ f va) n*(a, s)da 
Ss Ss 


for Se [t»t*), 


(4.6) V(t) = Berg Ay Ley set), t85%, (tgs9,0,0) 


(note: (4.6) need not hold if © ={p*}} If, in addition, 


i a ; , 
ve ye Beil, 22(t*),t43-2°,0) =O and @ <O for ice {-p,...,0} imply 
ot” peepee) = -,...,m, then y is non-zero on a subset of [t,.%*] of positive 


measure, 


iii) the following maximum condition holds: 


+* +* 
f HGS at? | Skis: f V(s)f*(2(°),s)ds forsall femmes 
1e 16 


O 0 
Proof: The definitions and conditions referred to in the following are con- 
Beened in[2e]. Since (z,t*) is a solution, it is a (,%,Z) extremal, 


where 
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P = (P15---5%,) 


m 
o = (P5~Po(Z5t*) P_y5 ++ +59 Vy 


4 : ees 


-U 


NN 
i 


+] : 
(oes RP : eos Oe) derailed |e 


Choose € ¢ (0,a-t*) such that z e Q(t*+€), (such an € exists by theorem 
2.3) and set +t' = t*#€. Define aa = Q(t!) x [t),t']. Let Y = 
C(La,,t"],R) x Re. Clearly condition 6.1 is satisfied. By theorem 3.1 
above, condition 6.2 is satisfied by M= #x[-€,€] and (pf) = 

eB) ,t* +e! gee where is given by.(3.7) and @(f) is the map 
@(B) of theorem 3.1. Theorem 6.4 in [22] implies conditions 6.3 and 6.4 


are satisfied, with 


(4.7) h(y,7) 


(dL,[ 2, ,2(t*) ,t*5y, »y(t*) 3 AUG. l| 000s 
O O 


dL [z ZU coy »y(t*) - Zi( eel Galles 
m vo vo 


(4.8) h(y,7) (diol 2, ,2(t*) ,t*sy »y(t*) + Zi Gta ayia gucteors 
0 ize 


ab_[2, ,2(t*),t*5y, sy(t*) + 2(t*)t,7])- 
OQ 
Q 


By theorems 6.1 and 5.1 of [22], there exist vectors a « R and @ = 


ea ,...,0° +) e RYT such that 
(4.9) ach(y,t) + Ge h(t,7) <0 for all (y,7) ¢ M, 


(4.10) lol +a] >0, 





D/ 


(4.11) GQ < 0 for a2 Oe 
(4.12) a o( 2, t*) =i 5 


From (4.11), (4.12) we obtain that a” =O for all ie bee 6 yh 
such that ~,(2,t*) < O° this and (450), (4.11) are part aie Suber tutine 


mee) and (4.8) in (4.9), for all (y,7t) ¢ M, 


oa aL.[z, ,2(t*),t*y, ,y(t*) + 2(t*)t,7] <0. 
L=-U eet 1G = 
O O 
From (3.7) and the definition of M, for all t) ¢« WM-p*, 8f « [¥F]-f*, and 


te [-€,€], 


(4.13) vie 


oe aL,f2, ,2(t*),t*3 Sp, Ox(t*38p,8f) + 2(t*)t, 1] <0. 
0 


fewe a) = O97 =O. trem | 559) and ( .15), torent sores lea peur 


| tx 
Zee yo abla, ,2(t*),t*30, f Y¥(s,t*)8£(z(°),s)ds,0] <0. 
0 t 


0 
Using (4.1) to define Y¥(s), interchanging the dL, and the integral, and 
Metane that 6f = f-f* for some f ¢ [#], this becomes iii). (2.11) and 
rel) imply (4.2), (2.10) and (4.1) imply (4.3). 


Let Sp = 0, Sf =0, te [-€,€}. From (4.13) and (4.3), 


W(t*)e(t*) 1 < -Zy_aL,Lz, 52(t*),t*30,0,t]. 
O 


Since this is linear and +t is symmetric about zero, we have (4.4). Applying 
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(4.1) to (2.9), then interchanging the dL. and the integral, we obtain 
Ht 


[re ) - 


Now let Of =O, t= 0. If @* € interior O)etherc cxist eee 


Beyen that if 


io-0*|| <"o) theme ' c oF 





Pt-=ze{pe C(Lo,,t,],2 ) 


From (3.5), (4-13), and the fact that -& « M'-+p* if & ¢ M'-p*s for all 


M&) ¢ Ex , 


i 
oe ye dh. [ ate z(t*) Does &p , OIL YC Ly t*) D( a , t) 


s ae Le 
a i : d {-/ d [¥Ca,t*) In(a,o) = f Y(a,t*) 7*(a,0)da} &(c) ] = Oc 
0 Xo 26 


Using (4.1) and interchanging the dL, and the integrals, we obtain for all 


op eH’ -p%*, 


te 


Ea sess Oe + V(t,)D( Sp, t,) 


to ee te 
+fd-F df¥va)]u(a,o) +f Wa) n*(a,0)da}&p(o) = 0. 
26 % & 


met P={f c¢ R'? [&| < p}. For each & € P, each C« (a, ,t,), define 


Ow 


PI dy 


O ; a, < Seas 
(4.14) BD, Cs) u 
(B-S)? SF So 








2g 


Note that, for all such €, ap (to) = & Thus, setting & = &. 
P 


the last equation, and passing to the limit as ¢ >to, 


(Xe, aL Lz, .2(t*) ,t*3Y, (t),1,0,0] + W(t, )]}E = 0 
== 1 ty vy 0 @ 
Remecilt € ¢ P. Thus the quantity in braces vanishes, which is (4.6). 
There remains only to show that, given the additional assumption, 
W is non-zero on a subset of [t,,%*] Of POSlblve Measure sue em sey oie 


G([a,,t*],R°) with Ix, || <9, define the functions w, on [t,,t*] and 
O 


? on [a,,%9] by 


Xx 


w(t) = S{D(x(+),t)] - at*{2(+),t5x(*)] ares on [t,,t*], 


Then, by theorem 2.4, x is given by 


B eo 
(4.15) x(t) = ¥(ty,t)D@,,t) +f “at-S af¥(a,t)]u(a,9) 


26 % 


ate i 
+ f ¥(a1,t) n*(a,0)da}p (3) + f ¥(a,t)w_ (or) dare 
% =O 


Define the functional on C({a,,t*],R°) oS et 
(Ose) Ele a’ aL.[z FATS) 8 a Mie 
L=-u 2: 7a 


From (4.13) and the fact that & ¢ #'-+px implies -& ¢ W'-p*, we obtain 


that, for all & « P'-p*, B(Sx(-38,0),0) =O. THus, from (4.1) and (4.15) 
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4% 
L(x,0) = f V(s)w_(s)ds. By the additional assumption and (4.10), 


“9 


0) #0, and so W(s) #40 for s ina subset of Lt.t4] of positive 
measure. This completes the proof of the theorem. 

We now wish to formulate a control problem with terminal manifold 
mama tunction space and a type of "bounded state variable” constraint. To 
Semriiiy expressions we assume the final time, T, is fixed. Let he 


[0,T-to]; Bg occaot Le be given real-valued, oo functions detinecanen 


2888 
C(La,,to],F4) x C([-h,O],4%)3 7 be a closed subset of [tT], @ be a real- 
valued function defined on (Gen Tak) XT, g and dg be continuous, 
where dg To eeneaPreeteu Citterent ta son g With res lees LO xe F pe a 
quasi-convex family; 64 © C([a),t51,4)5 and oy Saumsty (Gees potemar 


and (3.1). Define 


CS 
Fo 


= ty ° 
Zo = {ye Z 3 Vic) Om for alten y 


{x <¢ Q(T)}, Q(T) given by (3.2), 


Cine. 


Zo is a non-empty, open convex cone. Also, 


7 = Ce: ° 
Z, = ly ¢ Yo? y(t) <0 for all t € 7} 
Met the functions 9,2 BOR, 1 = -U,-0o,m, be given by 
@, (x) a es a ee 


where X,) m € C({-h,0],R°) is given by x, _) nh) = x(T+@). Let the func- 
eee, Bass 
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tion Py & > Fo be given by 
ye) = g(x(*),t) for all te Te 


Problem 4.2: We wish to find ze& such that 


a.) @;(Z) <0 for Io] ieee, 
b) ; (2) =) OMe, lee 
e) ®_,yh2) € Ly? 


d) @,( 2) =< 9,\%) forall xe & which satisfy a) - c). 


For such a z, let *, f*, and Y be given by (3.3), (3.4), and 


the remarks after (3.4). 


Theorem 4.2. Given the assumptions above and u(*,s) is of bounded variation 
on every bounded interval, s ¢ [a,,T], let z bea solution of probiem 4.2 
Bremeuhat there is at least one t' € 7 with OD = QO, and either 

@ ={p*} or @* ce interior @. Then there exists a row n-vector valued function 
Y defined on Gor a real-valued function 2» defined on R, and real 


numbers a, LSS oe Sik icles aleeiy 


i) ds) is a non-increasing function of bounded variation, con- 


tinuous from the right, A(T) = 0, and 4% is constant on each interval of 
R\{t' 6 72 g(2le),t') = Oo}. 


il er SG er 0, © SO er all i 2 (aqujseeyen)) shee dat 


p3(2) <0, Elo] + |a(tg)] > 0. 


iii) wW is given by 








(4.16) 


and satisfies 


(4.17) 


(4.18) 


(4.19) 


where 


(4.20) 
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— m af 
(2) Se ADL 2 2p 190 %p pot S eB 


7 
SE ie de[z(+),t;¥(s,°) ]aa(t), 
bo 


=o to? ran, 190? pen thts)! 


+ del al =), T3v(T)- 1 (AeA T=)} 


0,E” ] 


= i : 
MCs oi yo ADL 2s 2 7aon, 2° -~T-h,T 


a 
+f detz(+),t3E°(°) ]aX(t) 


+ 


a AE 
7 J df ¥() 1u(a, 8) - f ¥(a) n*(a, s)da, S € [t,.T), 
2 


Ne) 


— ah e 
¥(t)) ~ Ds 20 dL.[ “40? ?t-h, Tt," Ol 


(notes: (4.20) need not hold if © =(p*%}) If, in addition , 


oy 


a 
fe ,P di 12 


Fd ee | 
cag a yD 


=Q and Bp < OMEiowe dc (al). el eer ener 
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i ; : — 
mee 0, 1 = -[l,...,M; and toere Go mot exter Be aL eae Us clement > <O for 


ie {-p,...,0} such that, for every y « c({a,,TJ,R"), 


« ll 
a Nn 
Ds ape 1 (2, 2p ale nbn 1 
O 


then w is non-zero on a subset of [t,,T] OL POSi tive Mea aumes 


iv) the following maximum condition holds: 


T Ak 
f H(s)A(26-),8)as < f Ws)P(2(-),8)48 for ald f « (AI, 


ie 0 


meeot: Since z is a solution, it is a (@,9,2Z) extremal, where 


l= (Piye- +59). 
Nets (GS masa iy a 
+1 
G=-R” x F,, 
ale 
iy (ee Rit : ie <0, j = eer tts iy x Ly: 


fer # = ¥, Y- C(La),T],R) « Clearly condition 6.1 is satisfied. By 
theorem 3.1 above, condition 6.2 is satisfied with M = given by (3.7) and 
® given by theorem 3.le Fix x Ee Wo 
@_,,_yatey)(*) > ae) ee Cou po) = ete.) eu) 
= g(z(°)+ey(°),t) = g(z(*)4ex(°),t) 


+ g(z(°)4ex(°),t) - -e(z(*),¢) 
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= del 2(°)+€(0,(t,€,y)y(*) + [1-0,(t,€,y) ]x(*))},%3 
E Aye oxen) 
t (def 2(°)+€0,(t,€)x(°),t3€x(+)] 


- dg[z(°),t5€x(°)]} + del z(*),tsex(-)], 


where O <6 On < i By Ghercoct imu t yon de and ~ 9x ) 6 xiesigetice so ga 


ale 


bounded neighborhood of x, and uniform continuity of Zz over [@,T], we 


have 


Z+e, t) - Ze : 
lim . ee eee del z(°),tsx(°)] 
ca ) 
yx 


uniformly in t¢7. Using this and theorem 6.4 of [22], conditions 6.3 and 


pee are satisfied with 


4,2 = ' eo e . ; 
( 1) h(y) CAEL, 2 pn Von Tae 2 ne Venn)? 
022 h = . ooo ; 
(4.22) h(y) ATL 4 2 ran 2% Ven, Te 7D Ls oon Von TY 
dglz(+),°3y(*)])- 


Thus, by theorems 6.1 and 3.1 of [22], there exists a continuous linear func- 


mional ge ge and a vector de ca Suet tat 


(4.23) aeh(y) + o[h(y)] <o for all ye 4M, 
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(4.24) if aq=0, then #0, 
(4.25) OG) 0 aeons aac teze 
(4.26) Ol Cz ie— Ox 
: +] ; A eek =i 

Since EG = R x Zo there is a Vector” C= (co. meno 

eet aodea continuous linear functional. 2 E Zo such that 
-y-1 O 
=. tt) 

(4.27) Megas cot 4_ ily] for each (y,y) € R xX Boe 


Since (-e,,0) ¢ Z and (0,y) € Z whenever e, is a standard basis vector 


or ne and y € Z,, from (4.25)-(4.27) we have 


IN 


(4.28) 4_,ylyl 20 whenever y é 


(4.29) a O, 1 = O,-1.66cc.=, “and a =O for all 


te € Hele o const) such that (2) <0. 


(4.30) a sLa(2(*),*)] = 0 
meso, by (4.21)-(4.23) and (4.27), 


(4.31) De 


i ~ 
ple 227 DE Vent) * Ay bol ete) sesy") I) <0 
0 g. 


OGma Ey slic 








By the representation of elements ton ZS: Chere exists 2°f toerien 
meek —->R of bounded variation, continuous from the maiehtmeotct a0 sone oem 


sub-interval of RNr, A(T) = 0, such that 


aL 
ee. 52) f_ ly] = J VRCE UNCC emetdone LiL ye Zo: 


(4.28) implies that .% is non-increasing. From }% non-increasing and (4.30), 
% is constant on each interval J of [to 7] such that g(z(*),t) <0 


for all te¢edMnq7. Thus i) is proved. From (4.24), (4.27), and (4.32), 


cep | u | (to) >0O. Together with (4.29), this is ii). From (3.7), 


feo), (4.32), for all & « @-p* and Sf « [F]-f*, 


(e253) ae 


a. 
The dL.[ Sy aa ta, aD , oxn_n th 3 Op , Sf) ] 


T 
+ f_ dgl2(+),t38x(°5&p,dr]dX(t) < 0. 


“9 


fete a) = 0, of © [7 l-a*. @hen trom (2. (eo) eeard hoe 


Ar 
Yoon, v6 52°) BF z(°),s)ds] 
O 


i Q 
vi eat aI 2p _y Ord 
O t 
iD T 
+ f defz(e),ts f Y¥(s,°)8f(2(°),s)ds]aX(t) < 0. 
% 6 


By lemma 2.3, Y is Borel-measurable. Noting that the aL, and dg Ceprese ms 
mivegrations, we apply Fubini's Theorem tc interchange orders of integration. 


Mus, for all Sf ¢« [ ¥j-f*, 








oN 


Oo dL.[ 2 
U it 


‘ye 
ia 
i 


O 


Pease ee: nn oh Sy o) JSL( Z( *),s)ds 


el 
+ f (f del2(+),t5¥(s,°) ]da(t)} 8£(2(°),s)ds < 0. 
AG 
oF 10 
eames (4.16) to define Y(s), this is iv). (2.11) and (4.16) imply (4.37)2 


By (2.11), (4.16) may be rewritten as 


_ m al 
W(s) = Di eye Ahi 9 pn 73 09% pn a(S MW 


Al 
+ { dee etc, ean 


which implies (4.18). Applying (4.16) to (2.9), then interchanging the 
orders of integration (justified by a theorem of Cameron and Martin [ 4), 
we obtain (4.19). 

Now let of =O. If * € interior 6, there exists op >0O _ such 


lp-~p*|| <p}, then #Y' C FY, From (3.5), 





meat if &' = {p ¢ C({a),t5],R ) 


(4.53), and the fact that -S ¢ P'-p* if Sp « W'-p*; for all 80 « W'~p*, 


nF e e r=) 
ve yo aby 42 pen, TIOP? WX pn ol tos *)DC 49) 


- + 
T 


t At 
+L OAL al Yp pg gles") IMlO,9) +L Xp y glOs*)n*(a,0)20) 3(0) 
om vy e 


ie 
a J_del2(+),t3*If¥(t,,°)D(&,t,) 
6 


z pt T 


+f Pa-S ayty(a,*)Iu(a,o) + f Y(a,+)n*(a,0)4a}89(<) 
t 


“6 ao 0 


Chl 256) eg) 9 ae 
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where we use the notation 


e(s), s € [a to) 


O Siac [t,,t]- 


ap(ss3t) = } 


Interchanging the order of the multiple integrals (justified by [6 ]) and 


grouping terms, 


: ie 
1 ° Py o ° ry 
oan dL. [ ae aloe & ,0] ES J del rA( tee Gp (o3t) Jda(t) 

O 


eo ge . ° 
7 es th aL, [ 40? =n, 790? %g—n,o%o? )D¢ St) | 


IE 
+ J_dg2(*),t3¥(t,,°)D( &,t,) Jar(t) 
t 


cA ie 
O | dL ° ° | 


Dae pe, 
sd J do[/_aat 2( +) ,t3¥(a, +) 14x(+)] L(a,o) -&p(o) 
t 


O 
6 \ * san ; 
° S * 
+L Oadl TE Oatley sty 30%, 6s") 1M a,0) 40 
5 t O 





se Gt 
rd) ES aat (+) ses1(a,*) 18a t) Jne(a,9) 80 f29(0) = 0 
by Te 


Using (4.16), we obtain for all & ¢« _7'-x, 


; db 
OAD 9% p.n 78701 : f del 2(+),%5 (3+) JaX(t) 
O 


ae 


U 


+ VW(t,)D( 8, t)) 
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to ce T 
ai Sioa df ¥Ca) ii(a, 0) + f ¥Ca)n*(a,0)da)&(c) = 0. 
=O % “6 


NS 


Define wD ¢ by (4.14). Substituting this in the last equation and passing 
P 


meeche limit as € > Los 


Die 


i s 
2 A024 ston oie (Mos ),0] + ¥(t))}€ = 0 


for all & € P. Thus the quantity in braces vanishes, which is (4.20). 
There remains only to show that, given the additional assumptions, 
WV is non-zero on a subset of [t,,T] OF postu ive Measure.) hOrm cac mmeas 
C({a,,T],R°) with |x, Ics Ceceini a ae and eee in the proce *6hacieeren 
O - 

4.1; again x is given by (4.15). Define the functional on C([a,,7],R°) 

~ i nw 

L(*) = Me ay? aC, op nas J +4 ,(del2(-), 5-1). 
From (4.33) and the fact that & ¢ #'-p* implies -& ¢ #1%, we obtain 


that, for all & « P'+p*, L(dx(-;8),0)) = 0. Thus, from (4.15), (4.16), and 


(4.32), after changing orders of integration (justified by [6]), I(x) = 


T Ne 

f VW(s)w (s)ds. By the additional assumptions and rhb i Bf O, and so 
iF 

O 


V(s) # Omror 9S in a subset of [tT] Ci  pesmitye Measure. ~ This eomplcres 


mee proot of the theorem. 


= 





{0 


Remark 4.1. If g(z(-),t) <O for all tem, then 4g =Q and A(t) = 0 
T 


By eal 
forall t¢«R. Hence f ...-d(t) =O wherever it appears. 

%6 
Remar 4.2. In problem 4.1, the second component of the domain of the re- 
straint functions may be taken to be C([-h,0O],4¥%) as in problem 4.2, rather 
than ,¥. Then in theorem 4.1 we must add the hypotheses that u(-,s) is of 
bounded variation on every bounded interval, and that 2 exists on 
[t*-h,t*] and is bounded there (since % is clearly Borel-measurable, this 
Pe. ensure that it 1s integrable with respect to each of the measures as- 


sociated with dbL,[z, tI, © | le = Ul pete) ) oes omen elon seaaes 


9? teh, t¥? 
changes must be made in the theorem statement: In (4.1), (4.3), (4.6), and 


the additional assumption, z(t*) is replaced by In (4.1), 


t¥-h,t* 


Y(s,t*) is replaced by Y In (4.3), E is replaced by 


teh, txt 82"): 


4 Equation (4.4) becomes 


een txt ) : 


in st ; 
(yt) Meee Ts 24 exon, ta? 500 F enh tH7) 
al 
7 “ee aL, | By Asaaipio! PoDe: ie 
Equation (4.5) becomes 
_ aL S 
(4.5') VS \= oy ye T5024 Been te FOB Ean £070] 
fee +* 


+f afva)lua,=) - J Wa)n*(a,s)da, 


where E(t) is defined after (4.19). 


thas type Of restraint would be Guite natural, for vexample, 17 “the 











d 
system were governed by = D(x, ,t) = f(x, ,u(t),t), t € [t 4); where x, € 
C([-h,0O], R'), x, (8) = x(t+0) for 6 ¢€[-h,0]. For such a. system one also 


=U os 
has Qo 0 


The following lemma is useful in problems with a fixed terminal 


monction, 


n+l 


Lemma 4.1, Let os R +R be such that e( x,t) and g,(x,t) are con- 


tinuouss I(t.) be a closed subset of R_ such that T(t = (0) +t, for 


‘) 


t, € R and I(t.) E [o,,t,]s Py 0% ty) € C(I(0),R) be given by 


_ 6% #5) (8) = g(x(t,+8),@), @¢€1(0). Given (z,t*) « c(Lo,,a),R) x [to,2) 


such that z exists and is continuous on a neighborhood of eae then for 


Bal x € C(Lo,,2),R), 1 @ ik, 


P_, (zey, tha) - o. 1(2,t*) 


5 (2) 


lim 
& >of 
o> T 
5 aa? 


= & (2(t¥46) ,6)[x(t*+0) +2(+*46) 7] 


uniformly in @ € 1(0). 


4 


Poors Fix (x,t) € C(La,,2),R°) x Re For each @€ (0), aby © 5 Bea eon eh 


O_ (at y, t4€0)(8) = e(2(t480) ey(t+€0) ,2) 
= g(2(t),0) + e(2(t)4ex(t),0) - B(2(t),@) 
+ o(2(t)48x(t+c) ,@) - 2(2(t) +€x(t),6) 


+ B(a(t)€y(t4€0),6) - Bl z(t) ex(t4€0) ,6) 


+ g(2(t+80)+€y(ti€o) ,0) - B(2(t)+y(t+E0) ,6) 








iE 
= g(2(t),0) + & (z(t) (6,6)x(t), @)Ex(t) 
+ & (2(t) €(€,(0,€ ,0)x(t) +[ 1-£,(6,€ ,0) ]x(t4€0)},€) 
elk Gaete onda) 
+ B,(2(t) #€{8,(6,€ ,0,y)y(t+€o) +{ 1-£,(0,8,0,y) ]x( t+€0)},0)- 
o&[ y( tea) -x(t4Ec)] 
+ & ((8),(6,€,0,y)2( t4€0) +[ 1-£,(6,€ ,0,y) ]2(t) }+ey( +480) 8) 


of z(t+€0)-z(t)], 


where O< s, Wie 1625, oe noe core cache com. mmcone 


9 W(2t8y,t*48o) -@ _(2,b*) 
(4.34) aa 7 é =~ 8) 
= &(2(t*+6) ,0)[x(t*+9)+2(+%+6) 7] Bs GUE poly) 
where 


C(65€,0,y) = [e (z(t) 4€£,(0,€)x(t) 6) - & (2(t) ,6) x(t) 
+ g (a(t) 4€(6,(6,2,0)x(t) +[1-6,(6,€,0) ]x(t+€0) ,6). 
°[ x(t+€o) -x(t) ] 
+ 6, (a(t) +€(8, (0,8 ,0,y)y(t4€0) +[ 1-8, (0,€,0,y) ]x(t+€0)} ,8)* 
*Ly(t4o) -x{ t4€9) ] 


+[ 2 (6) (0,€,0,y) 2(t+e0) +[ 1-6) (6,€,0,y) ]a(t) } +€y(t+€0) , 6) 
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-&,( a(t) 0) 7 Abeo-at) 


+ E,(2(t) ,@)£(+,€,0)-2(t) Jo 


+ &(2(t) 0) 2(t)[o-r], 


and the vector wW is given by the components ¥,(4,€,9) = 2 (t+€8)  (€,t,0)9), 
Mey2,-c0,n, with O< & , <1, 1 =1,2,.c0,n. Since g, B. z, and x 


are continuous, and z is continuous on a neighborhood of T(t*), we have that 


Ibi WK eGS 68) | = 
SS ie ae 
o3T 


Vive oe 


This and (4.34) prove the lemma. 


i. ‘2 2 i i ° = oI ° 
Lemma 44 Let g, be as in lemma 4.1, ®_yh%ty) a. a( x(t, +9) ,8) 
Given (z,t*) as in lemma 4.1 such that P_ 16 4t*) = 03; then for all x eé 

n 
C([O,@) ,R poe 
? (zi€y,t*41€0) - (z,t*) ‘ 
Lim (SS See er ech slab 
ge 30 € 


o=-T 
\ mga 


= sup (g.(2(t*+0),0)[x(t*+0)+2(t*+0)T]}. 
ie TCO) eee 


Proofs The proof is essentially the same as the proof of lemma 4. 


Remark 4.30 In both lemmas, if t* =T is fixed, the term 2(t*4+0)t does not 
appear and it is no longer necessary to require that 2z exist on a neighborhood 


of I(t*). 
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We now formulate a control problem with a fixed function as target. 
tet h>O be fixeds ¢€2 [-h,0] ->R' be ct (see remark 435 below), ¢ # 03 
We be a diagonal matrix whose entries are either 0 or 1, Such that WC = ¢ 
L, be a real-valued, c* function defined on C(lesy enlace) x C([ -h, oR ) x 
[t28)3 IF be a quasi-convex family; 6 C C(IG,t1,F); D(x(* ee eabasty 
feo) (2.5) and (3.1); & = {{x,t): t € [t,.2), x € Q(t)}, where Q(t) 
meeeiven by (3.2): Ore = C([-h,0O],R ); and ne {fy ¢€ F 3 Vie) ©) nem 


@ « [-h,0]}. Define the function 942 SOR by 


Cp) = Gao as G5): 
Omer ed Og) taeda te) 


and the functions P;3 BE Zos i= a2. by 


p_4(25%4)(8) = (9) 6(@) - wx(t,+0)], 


P_o( x, t,) (9) [Wx(t, +0) 1° _ cea }?. 


Problem 4.3. We wish to find (z,t*) ¢« & such that 


a.) ©, (2,t*) E Zos eee 
b) 9, (z,t*) < Po (x, +4) for all (x,t,) ¢«¥ which satisfy a). 


or sucha, (z,e*),. lee O*,4*, and ¥ be givem by (3.5), (5.4). 


and the remarks after (3.4). 


Remark 4.4. We note that for any (x,t,) satisfying a), Wx : = Coa Domania 


Tustrate the use of such a W, where W # E, Suppose we have the following 


Raa 


t4-h, t 


problem in C([a,,T],R 








1c 


d 
ox —_—— 


q 
ae ?; az s(t) = i d[u(t,6)]x(@) } = (XU) a taye 
O OL 
0 
We wish to control x so that x(t) = (t) on [T-h,T] and the cost 
ale 
Bou) = f f'(x(-),u(s),s)ds is minimized. Assume the appropriate hypotheses 
t 


are satisfied, anc i satisfies the same hypotheses as ie We then set 
( " 
2 + ( ), 
x O 0 


u(t,6) 0 f(x(+),u(s),s) 
u(t,@) = , f(x(-),u(s),s) as Ee. , 
O C £n(x(+), us) s) 


C 5 GO . 
5 ( » WwW = where I is the (n-1) x (n-1) identity matrix, 
0 O 0 


it X 2X _— egg GUTS The augmented problem is in the form of problem es 
O to -h,T 


Theorem 4.5. Given the assumptions above and, for every s € [Q,a), (+, S) 
is of bounded variation on every bounded intervals let (z,t*) be a solution 
of problem 4.3 such that %Z exists on [t*-h,t*] and is bounded there, Wz 
exists and is continuous on (t*-h-B, t*4+8) for some B >O, and either 

@ = {o*} or o* € interior 6. Then there exist a row n-vector valued 
function W defined on [ty2™) a real-valued function A» = 2A, - A, de- 


2 at 


mined on R, and a real number a, such that 


i) \, is a non-increasing function of bounded variation, continuous 


mom the left, d, (07) = 0, A, constant on (Seep aul) eiialsl tela (Oyen sh Le 
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1) as Sieenmias 
O 
55) v( s) aa diol nee “£%-h,t¥ O85 05% xn txt s,° - on 
ot 


+ J C(@)¥(s,t*+0)dMe), 


and satisfies 


(4.36) (Ss) Omen OTmES Ms Ur. 
(4.37) ¥(t*) = ATLA, 92 eect? FO Yew tal Oty +) 10] 
- €(0)0), 
(4.38) W(s) = oral “ty? t¥-h, tb? t*50, eae 0] 
te” 


S 
, ir C(O)E (t*+0)arx( 0) + f do ¥Ca) ]uCa, s) 
-h Ss 


t* 
= if ¥( a) nla, s) dar 


for sé [t,,t*), where E(t) is defined after (4.19), 


EO 1] 


Wg 
( 39) le? all ae 3 ce me ee 


5) teh, t¥ 


Ovi 
~ J (6) (@)aar(e) = 0, 


\ = = . a ae Ke : 
(4.40) W(t) ad Jas beh, te” 5%, (os ),0,0] 








of 


iii) the following maximum condition holds: 


oe t* 
i Ves)i(Z@ \es)ds J W(s)f*(z(-),s)ds for all feF, 
Ie 


0 0 


Remark 4.5. If t* =T is Pies (4.59) does not appear and it is no longer 
necessary to assume that e and 2% exist. In most cases the derivatives will 
Exist, and the effect of fixing t* is to remove the requirements that t 


and Wz be continuous and z be bounded. If © = {p*}, (4.40) need not hold. 


meeots) cince (z,t*) is a solution, it is a (%,Z) extremal, where 


9 = (Py - Oo(z,t*), O_4,9_o), 


x 


RX J, x Zo 
= Se : 

Z={reRi y<0}xZxZ 
Choose € € (0,a-t*) such that z ¢€ Q(t*4+€), (such an € exists by theorem 
205) and set t! = t*#€. Define J) = Qt") x [t,,t"], Y = A la,,t'],R) x Re 
Clearly condition 6.1 is satisfied. By theorem 3.1 above, condition 6.2 is 
satisfied by M= Ax [-€,&], where # is given by (3.7). Theorem 6.4 in [22] 
Mmpiies condition 6.4 is satisfied for 5 when 


= xe 7 ° 
a) bol) Mol 2524, te? 34 Vox—n te beh, oe? 


By lemma 4.1, condition 6.4 is satisfied for @_, when 


h_j(y,4)(0) = -C(@)[Wy(s#+0) + W2(t*46)<], 





———— 





ana for Po when 
h_o(y,*) (8) = QWz(t*+0)[Wy(t*+0) + W2(t*4+6)T]. 


Since Wz = @ and (W = (€, these ere 


eh be oP) MSER nee 


(4.42) b_(y57)(8) = -C(@)[y(t*48) + t(e)7], 


(4405) h_oly,t)(8) = 26(8)[y(t*49) + (8)7]. 


By theorems Gee end o.l of [22], there exists a non-zero 2 € es such that, 


n= (hh 4h 4); 
(4.44) i[h(y,t)] < OF for aiieiGs t) eh, 
ere) [pa So mee AIL Se Se 


Since 9 = R X Zo x F 0) there are an a@° € R and functionals 


* 
e £,, E Ze such that 


i? 
(y,w,&) = ar + £4 (2) + £,(§) for each (y,w,6) € Yo 


* 
By the representation of Fo: there exist functions 4,8 RR of bounded 
variation, continuous from the left, A, =O on (0,~”), X, constant on 


(-0,-h], such that for Wé Zo: 








its, 


a0 


£ (a) = f o(6)dr,(@), i = 1,26 


Substituting the above and (4.41)-(4.43) in (4.44) and (4.45), we obtain 


O : 
(4.46) a dL [2 eran Oe! 


ty? toh, t*? “34 Vth, t 


om ° 
- eo C(O)Ly(t*+0) + (0) t]aa,(e) 


O ° 
+ 2f C(@)Ly(t*+8)+0(0)t]ar,( 6) <0 forte (oes 
h 


o* on 


fey. 47) ay + f a 6)dr,(8) + ji £(@)d’,(8) >0O for all (y,0,&) aie 
~h a 


Bice (-1,0,0), (0,0,0), (0,0,w) €Z if we Za, from (4247), ao <0 and the 


Ol 4 var A, + var Ny > Oe 


[-h,@) [-h,@) 
Thus i) has been proved. From the definition of M and (3.7), for all 


d; Peeemecreasing. £ 4s non-zero, hence la 


Sp «P-p*, of ¢ [F]-f*, and t € [-€,€], letting 2(6) = 2a,(8) - ,(8), 


(4.46) is 


O ° 
et. 45) a Bol 24, 2 Be xan, tx? O83 OP Xan gx 3 OP OF) + Zien tee 


o* 


+f C(6)[ 8x(t*+05 Sp, Sf) + 6(0)t]aX(@) < 0. 
Eh 


het G =O, = = O05 by (5.5) and (4240)5 for all of <« [9 |=, 


t* 

2 = 

. Moly, 2% exon, cH? 700d ena 2 abel Ses, 0] 
0 

+* 

+ f ¢(e)f Y¥(s,t*+0)8f(2(°),s)ds dace) <0. 
-h to 


+ 








SO 


By lemma 2.5, Y is Borel-measurable.e Interchanging dl, and the imvesgna 
in the second term, and defining wW by (4.35), this is iii). (4.36) and (4.37) 
follow from (2.10), (2.11), and (4.35). Applying (4.35) to (2.9), then 
changing orders of integration (justified by [6]), we obtain (4.38). 
ret & =0, of =0, t € [-6,@]2 then (4.48) is 
aaL [2 t*°0,2 


Z cha 
ty? t¥-h,t*? teh, tx? 274 


4+ 


O , 
+ J s(a)&a) santa) < 0% 


Since t is symmetric about zero, this implies (4.39). 


Now Jet Of = 0, T = Oso Uf ©* eiiverior On tierce e coc aoe © 





such that if #' = {p « C([a,,t)1,R ) ip-p*|| <p}, then FPtc HW From 


(3.5), (4.48), and the fact that -& ¢ M'-p* if & ¢ P'-pxe for all 
pc HP * -% 


: ¥5&,0,0 
(oi Aol 2, 27h tH?” 7A, 3 ] 


O o e i=] 
io Clipe te D(&,t,) 
+ a aNot 24,2 7x, tH? 205°» i teh, t* 0’ ) =O 


be ee 4x 
+ [ Ca t-f dol Vex, pelos *) Ju(ana) 4] Yen, tal 2) 14 c.0) aa} 89( 0) 
=O %0 0 
On to txt 
+f (0) [¥CtystA49)D(8Psty) + FPG L-L aol ¥(a,t*+8) IM(aye) 
-h ¢ o/ t 


O 0 
4% 


+ f Y(a,t*+0)7*(a,0)da} &(0)| ari Q) =O. 


“6 


Changing some orders of integration and using (4.35) this is 
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O Pa 
Os dLol ai Ze xh tx? OS &p,0,0] mh (45) D( op, t) 


on coe t* 
0 \ 
+fodf-f dfv(a)]u(a,o) +f wla)n*(a,0)da}&p(c) = 0. 
O% bo Uy 
Define BD ip by (4.14). Substituting this in the last equation and passing 
4 
to the limit as v De: 
O : 
{a diol “to? een tH? IM, (tos OC W(t) IE = Q 


for all &€ ¢€ P Thus the quantity in braces vanishes which is (4.40), and 


fede proot is complete. 


Remark 4.6. The conditions of theorem 4.3 will be satisfied if a® = 0, 


Xr. 


5» is any function satisfying the restrictions in oad aN. = ones. eae 


ak 2 
examples in chapter 6 will show that there are cases in which a non-trivial 
maximum principle is given by theorem 4.33 but they also require that (¢(9) # 0 


at points @ where 2 has a jump, further restricting the class of ¢ which 


can be used as target functions. 


4 


Remark 4.7. Problem 4.3 may be expanded to include more restraint functions 
L, as in problems 4,1 and 4.2. The corresponding GL, will then appear in 
/ as in theorems 4.1 and 4.2. The additional Ls may be used to restrain 
coordinates of x not specified by ¢€, as well as to define an initial mani- 


fold in C([a,,to],F)- 


Remark 4.8.. The general method of proof used above can be applied to obtain 
necessary conditions for a wide variety of constraint functions. In particular, 
there are many functions which do not have a Frechet derivative, yet satisfy 


the requirements of [22] (see [21] and [22] for examples). 
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Remark 4.9. Theorems 4.2 and 4.4 use the same method of treating the bounded 
Beacve variable constraint based on Zo In [el, section 8], Neustadt also gives 
a method of treating bounded state variable constraints by a supremum function 
This treatment of problem 4.3 is presented below for completenesss the non- 
linear maximum principle it produces is very difficult to work with. In ad- 
dition, due to the non-linearity, although a pointwise maximum principle is 
implied by the integral maximum principle, one can give examples where the 
pointwise maximum principle does not imply the integral maximum principle. 

Let h, €, W, Ly, A, 6, D, and & be as in problem 4.3. Define 


fae Tunctions Ps SR, sige rey lh (6.0. lon 
? (eae ) = IL (x ae yt ); 
O a 0 vo ty h,t, ji 


QO 
9_,(%,t,) = F Sca)t se) - Wx(t, +0) 148, 


2 2 
9 o(%,t,) = sup {[wx(t,46)]° - [£(@)]°}. 
ae a ge[ -h,0] 1 


Problem 4.4: We wish to find (Zt) seme suche tad 


a) @,(z,t*) 5 0 ae Soe 
b) Po (z,t*) S Po(%t,) ere BVI. (x,t,) ¢¥& which satisfy a). 


For such a (z,t*), let *,f* and Y be given by (Gea) (Ge 


and the remarks after (3.4). 
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Theorem 4,4, Assume the conditions above; satisfies the conditions of 
lemma 2.6 and lemma 251 cel UChr Bip nO ie h(t) = t-d), 2 = perrrier Co .s) 
1S Of bounded variation on bounded intervals for each s € [O, 4); and for 
each Te [t,8), Tare [% TI, € > 0, there exists) (6(Gyt 0 a> Omecucememam 
fe-t| < p(6,7,0) implies | vVGeau evs) a) Content minemoec [t),T]- Let 
(z,t*) be a solution to the problem such that 2 exists on [+t%*-h,t*] and 
is bounded there, WZ exists and is continuous on (t*-h-B,t*4+B) for some 

fe 0, cither © ={p*} or has € inverior 0, and for al l@ew < BV([a,,a),R°), 


te [t),a), the map s +f w(a)n*(a,s)da is continuous on [t),2)> Then 
S 


: , Ny Ny 
there exist functions ys Lt») —R and W,3 [t,,%) x [-h,0O] >R *, and 


- -2 
real numbers a” ,a ate such that 
‘)) Ce Renn ipe 2). lei || > © 


=) Y and ¥, are given by 


iiss) (S55) 0] 


7 ¢%—h, 0% 


O 
= L 
¥(s) ad ol “ty? beh, t¥ 


O 
- af £(8)¥(s,t*+6)a9, 
¥,(s,8) = 2C(6)Y(s,t*+6), 
and satisfy 


GS) =O meinctac nm oan 


v,(s,8) he tomers ur ac. 








on 
O : A 
bse) arte Tol 2 Pex oh ta? 902 F een tal ),0], 


¥,(s,8) = 20(0)) fon eycm=—e oy 


Wis) = arabe z t*30,E 0] 


Ss 
ty? b*-h,t* t¥oh,t*? 


$x4 


QO 
-"f ((a)E(te+0)de + fa f¥(a) Ju(a,s) 
-h Ss 


tx 
-{ v(a)n*(a,s)da for se [ty,t*)» 
Ss 


where E(t) is defined after (4.19), 


ze o* 
¥x(s,8) = 206) +f afvj(a,0)In(a,s) - f ¥,(a,6)1*(a,s) da 


LOrses € [t,t*+6), 
O xo . =i - Fe 
‘oF Aol 7 2 exon tH?® Ee neal = J S(@)S(8)a6 
== =e ° 
€ co{-2a GD d G2) i Cie: (iy, Ole 
where co denotes closed convex Inde. 
O eo e 
OY MO yo? tach te SH, (top ),0,0] + V(t) 


€ eq (-a7“y,(%,,9) 6 2 |hsle,O] i) tu (-a"“v,(+,8°)3 Gel =h, 0] } I 
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iii) the following maximum conditions holdss 


L¥ 
J CS) BZ Gees ee £*(z(°) 5.8) }ds 
% 


APs 
<|o*| sup {f ¥,(s,6)[#(2(+),s)-£*(2(+),8) 145} 
7 é<[-h,0] t, 


for all fc #. 


Remark 4.10. The proof follows the same pattern as the three given above and 
will not be presented here. The proof of the last condition in part ii) in- 
volves interchanging a limit and a supremum, Lt is quite tedious. If © ={ 9%, 
this condition need not hold, and the assumptions on w and 7* in the 
statement of the theorem may be replaced by the assumption that u(°,@) is of 
ounced variation over bounded intervals for @ ¢ [a ,a) 

1E 
Remark 4.0. Conditions for the map s > f w(a)n*(a,s)da to be continuous 

S 


mor all w ¢ BV([a,,4),R) were given in remark 2.5. One obtains an 7* 


me 7oermicd there if the quasiconvex family has elements of the type 


f( x( 2) 15) es P(E) pol g(t) ) »x( Bo(t)) , 0 oy x( g,(t)) , 


' 
J ao[1(%,6) 1G(x( 6) ,@) ,t), 
% 


a =— 


where the €, are as in remark cop, Wy “Satisties the Sawewmpouneoesnas 7 


mimremark 2.5, and G is oy in x and Borel-measurable in t. 
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5, Sufficient Conditions and, sxi acence 


We present two types of problems for which the necessary conditions 


of Chapter 4 are also sufficient conditions. Suppose for fixed T >t) we 


are given the n-l equations 


t t 
(5.1) spli(t) - J 4,[B(t,0))]%(0)) = J a,[i(t,o)Ix(e) + K(u(+),s) 
O 'O; 
O O 
a.e. on [tT], 
- — = : a nel 
>.<) XE =, a fixed element of C([a,,%,],R A 
iiesser Of restraints 
i .5) Lippe = 0, l=1,...,m, 
(5.4) uéQ = {(v: v measurable on [t,,Tl, W(S)ee U(S)mtor as [t,.8)} 


where YW Gana, U: [t,,T] > subsets of YW; 


and the cost function 


T 
ion n,- 1 
5.5) J(u) = AC a + f [£°(x(s),s) + k'(u(-),s)]ds. 
So 
Let ww satisfy (2.4), (2.5), and (3.1), p(-,s) be of bounded variatior on 
[t,,T] mor ail sc [o,,T]3 7 satisfy (2.8); k and k measurable in Casey 
|k(Q,s)| + |k (@,s)| <M(s) for sé [t, 7], Me Tae ae BE Tig be linear, 


m= 1,...,m, (1, : i =1,...,m} be linearly independent; £'(y,s) be C™ and 





7 


ib 


; oa) ; ; = ne 
convex in y for each sg «€ [tT], measurable in s for fixed yeR , 


-l 


n 
and for compact XC R there exists m e¢ (Ee AE) -Such that 


= Aye es on oe 
lf (y,s)| <m(s), |—--(y,s)| < m(s) for ye X, se [t),T]; e(¥) be cl 


x 
and convex in Y « O(n Giee: aan 
We now augment the system, setting x = (x,x'), xX, = (9,0), 
S 
k(u(+), 8) ~ CGICS ey k (u(-),s)), ES) ~ cl dol i(s,6))x(@), # (x(s),s)), 
ne 
and BCX ep) = 8p np) Assume that 7 = (Fr P(x(-) js) = fx@ eos 


k(u(-),s), vu € 2} is a quasi-convex family. (For example, satisfies the hy- 
potheses of lemma 3.3. If k is linear in u, there may be delays in the 
control; see Banks and Jacobs [¢]). The augmented. problem is a special case 


of problem 4.2, where L.(x, ,x 
a by 


) +x (7). 
ky 


T-h,? = 109 yo)? bare) eae 


Lol %, 2% a—n, 0 See 


=ia3 
Theorem 5.1. Given the assumptions above and u¢éQ with response Zz _ satis- 


fying the necessary conditions of theorem 4.2; then if on # O, WU is en ° operas 


ePonvrol. 


Proof: Note that the assumptions of theorem 4,2 are satisfied. Let Y be the 


Mm Xn matrix solution of (2.9)-(2.11) where 


(toe. 20 0 @>t 
u(t ,@) -( ), n(t,@) = f_ 7 
0 0 iin) 0 
_ Peet 
of 


oo aes ACo hae) 0 
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and x be the response to a control v¢é such that Li, (2% = 0). 


_n,v 
me 1l,...,m. Since dal2niy pid, GLilZn py pi I 1 = liew,M, are Contimieme 
Hinear functionals on Cre inole air there exist d,: R = ae i= QO) ee om 
bounded variation, continuous from the left, d.(s) =O sie Oypea nc (8) = 

n 
N(-h), s<-h, i= 0,...,m, such that for any y € C({[-h,0],R )}, 


Ou ot 
dalZp_p giv] = J GL AOC) 18), AL Len, sy] = fo d[r, (8) ly), 


ee, ,,m. Also, since neither g nor any of the Li. depend on Z 
(Ss) 2 (X,(s),0), s ¢R, i=0,...,m. Hence, for y given by (4.16), from 
(4.19) we have 


cite c 
5.6) Ws) - f aL ¥(a)]u(a,s) + f V(a)n(a,s)da 


m+ 
: ats aa (@= 0) lee (peep) 


<= ie 
+ venom J do r,(9-T)], S € [tT]. 


aL 
S 
my Lhe form of the Ns 3 acta) jet Ot cele mpage < [tT], v'(s) a a. 


Since x and z satisfy the augmented equations (5.1), (5.2), 


mt tc ot 


T 
O=f aty(s)Itx(s)-2(s)] - J aCW( 8) dal u(s, 9) ]tx(8)-2(9)] 
0 ie to 


s 0 n(o,@) 0 
+f f agt(7 ; )atx( 0) -2(0) 2c 
t. t : 


Ss O 
+ f ( age do 
t, \f (4(G),0) - © (a(G),,0) 
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S 


+ { [k(v(-),0)-k(u(-),0) Jao 
ic 


pt pt + 


At 
o=f a v(9)}tx(a)-2(8)] - fF aW(s)1f aglu(s,9)]¢x(8)-2(0)] 
t 


O O O 
+ : 


aE 5 iN 
=) Ok se 
ve 15 % 


dol (a, 8) IL x(8) -2( 8) Jao) 


+ 


ib Ss 
-~f alv(s)]f ( 5 ; do 
“o “o £50), 0)-#"(2a),0)- LA2a), of %0)-(0)} 


T7 Ss 
-f dfwCs)]f (k(v(-),¢)-k(u(+), 0) ]do. 
t 


0 


Integrating by parts and noting that W(t") = 0). 


+ 4 = 


a a 
o=f alv(a)[x(e)-2(6)] - J d{wW(s)]J d.fu(s,@) I[x(@)-2(6) ] 
t t t 
0 0 0 
T ey 
+ J Ws)J dof n(s,@)]{x(8) -2(8) }ds 
“o  *o 


At O 
+ f Ws) ad ds 
Xo £"(x(s),s)-£"(Z(s),s)- <—(2(s), 8) LX) -2(s) 


7 
+ J Ws)[k(v(*),s)-k(u(+),s) Ids. 
5 


; ; ; n O 
Changing some orders of integration and using wW(s) =a, 


pt ~r T 
o=f dg{v( 6) -J d{v(s)]p(s,e) + f WOs)n(s,@)ds}[x(@)-z(6)] 
176 & oo 
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O . n= a eo = 
+ aa (f (x(s),s)-f (2(s),s) - ~o (7S); ahe)- 20S a 


Th 
: J W(Os)Ek(v(+),s) - k(u(-),s) ]ds. 


O 
By ie.°), 
pt 
O=a{-f dol A(0-T) If x(@)-2(@)] - [x(t)-2°(7)}} 
& : 
me i0 
er MeN 8 
O 


O 2 a, n,- of — = — 
+P f (£%H(s),5)-£(Z(5) ,5)- LCE), 5 1H s)-2(s) Jes 
vo x 
AL 


+ f ¥(s)[k(v(-),s) - k(u(-),s)]ds. 


%9 


my ume definition of the Mey lIMearty Of one ~ li Vanes raeunceles 


1? 
Ls(%pip op) = By(@pip pis be Leeeee™ 
aa Ot -del 2 a Xp, tan, 2 - (x(t) -2°(7) 3 
O : ny, n- a ae a 
+a f (f (x(s),s)-f (2(s),s) - —(2(s),s5)[x(s)-z(s)]}ds 
fe Ox 
O 
ak 
+ J wWs)[k(v("),s) - k(u(+),s) Ids. 
5 
0 
Since a f O, we may assume a = =ale 


Hu)-I(v) = 2p, g) +2 CT) - B%py og) > (7) 
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= Ce pp) 8l4p yo} + 2 (2) - (7) 


~{~dgl z en ae z(t) 


4 nae ] 
[-h,T?°T-h,T T-h,T 


oft 


x 


ty 
- f(2G(5),8)-2(E(s), 9)- ECE) 5) (56) (5) as 


At 
+ f Ws)[k(v(-),s) - k(u(+),s)]ds. 
a¥ 
O 
meeume Convexity of g, convexity of a) nbeha dseeld SS [t 5,7, and the 
assumption that u satisfies the maximum condition, J(u)-J(v) <0. Thus u 


ienam OpLimal control. 


Pete. t, If we are dealing with the free endpoint problem, the necessary 
conditions ensure that a® is O, and so we need not assume it explicitly. 


Now suppose we are given equations (5.1), (5.2); restraints 
(5-7) G(e)L ee) - x(T+0)] <0, @ € [-h,0], 


(5.8) Gee aaenl <0, Oo Sano. 


n-1 


where € ¢ C([-h,0],R ), € #0, and (5.4); and cost function (5.5). Augment- 


ing the system as before, we obtain a special case of problem 4.3, with 


E O 
C = qo), W -( ), and LO, 


= g(x ) + x (T). Assume the 
aes T-h,T 


3th, D 


fondiGion given before theorem 5.1, 


Theorem 5.2. Given the assumptions above and ueé%& with response z 
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satisfying the necessary conditions of theorem 4.3; then if 9° 7? Oe 


eteeotLimal control. 


Meoot: Let Y be as in theorem 5.1, x the response to a controlyyy cm 


such that f Assume a° = -1,. Then for “i eetveuse. 


: 
Ty “Yh, T 
(4.35), from (4.38) we have, as in the proof of theorem 5.1, 


=¢t=W 


+ 


AL 
59) Wis)-f d[¥{a)Ju(a,s) + f ¥(a)n(a,s)da 
S S 


ot o* 
=j[ |i dr, (8) Oyo or ey day pres |= Cen elycel) = Jan Sec < 7: 
s-T s-T = 
= ot , Or 
=[ dA(8) + (One oe +f €(a)dr(e), to Ss SS Eau 
-h =i a= 


Again, v(s) = -l, We also note that 


ae 


ik 0 
f af (@)aa(e)}[x(s)-2(s)] 
T-h s-T 
T o* 
=f aff t(@)ax(e)}wlx(s)-2(s)] = 0. 
T-h s-T 
a ; 
iy . . - - AL 
Meine this in place of Dec: iF (Xx, hp 2p eh a O, we obtain as in theorem 


eel, 
Oe ale aL “x 2 ] - (x (T) z°(T)]} 
Se eee Cat 


- J (£"(X(s),s)-£°(2(s),s)- of (2(s), s)[x(s)-2(s)]}4s 
to x 
dk ° 
+f Ws)ix(v(+),8) - kCu(+),s) Jas. 
ize 





oe, 
Hu)-Tv) = -Celsp yp) Clty py 7) “SE 29 oP one Pe-n a)? 
; n,- n,— or” _ -- _ 
=| (f (x(s),8)-2 Claes) ay AS) 
+ aa 


ih 
+ [ ¥(s)[(v(-),s)-k(u(+), 8) ]ds - 
%0 


By the convexity of g, convexity of f'(*,s) for each s ¢€ [to »Tl, and the 
assumption that u satisfies the maximum condition, J(u) - J(v) <0. Thus 


u 1s an optimal control. « 


We now give conditions for an "attainable set" to be compact. Let 
(S,e) and (X,d) be metric spaces, $(X) be the collection of closed sub- 


feeewor X. For a set AC X, define 


Jo lA] eyixec Xo baerevextctc. ypc Age cucimt ia mmd( ay eae le 


Definition 5.1. The mapping F: S ~ Y(X) is said to be upper semicontinuous 


meerewtaled UoSeCe) at t. € S if lim sup F(t) < F(t where supremums 
= O/7? 


G po 


O 


are taken in Y(X) ordered by set inclusion. 


Definition 5.2. The mapping F: S ~ Y(X) is said to be upper semicontinuous 
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with respect to inclusion (abbreviated u.s.c.i.) at t) € S$ if for each € >0 


where exists a 5>0 so that e(t,t) <6 implies F(t) C I,[F(to) I 


We consider the system of equations 
d 
(5-10) ap D(x(°),t)] ACEO 15) 


(eo 1.1.) me = 0 © VY eY es compachuces an | Cia. e oR). 
7a Or 10a 


under the following assumptions: 


fs 12) Conditilovsa (aes ecm mand ( 58 aed. 


f..13) The mapping Us [tT] > 6 (R’)\{B} is) esse omou [t,.T], eet 


9 


given constant, T >to 


(5.14) iM xX e([a,,T],R°) x [t,.T] +R” is such that (u,¥,t) > 
#(u,¥(°),t) is continuous in (u,#) for fixed +t € [to.T] and 
measurable in t for fixed (u,v) € MX ele, PLR) where 


M = U U(t). 
te[t,,T] 


15) There is an integrable function A? [tT] => Ave 0, Such! “cae aan 
n 
(u,¥,,t), (u,¥5,t) «MX C({a,,T],R ex [t,.T], then 


| f(u,¥, (+), t)-£(u,¥5(°),t)] < ACt)II¥, -Yoll,» 


>. 16) For all u € U(t), | f(u,t(-),%)| < v(t)[B + Il¥l4], where v is 





9) 


integrable on [t> 7] and B is a positive constant. 
ie 17) T is a non-empty, closed subset of [tT]. 


(3.10) COU ie) are ((u,t,)s t, € 1, us [t,t] ee, u measurable, u(t) € U(t) 


@oe€e On [t,t ]}- 


(5.19) The set £(U(t),W(°),t) is a closed, convex subset of R” for each 


fixed (v,t) € C([a,,T],R°) fle 


(5.20) The set-valued mapping Y ¢€ C(La,,%],R°) > £( UCC), V(* te eee 


for each fixed t ¢« [t TI 


The conditions (5.12)-(5.18) are sufficient to guarantee that, corresponding 
to each @ e€ Y and (u,t,) e 2(U,1T), there is a unique continuous function 
(response), x(°s,u): [Q%,,t,] Sige SGyoaishevaheer (5) 10) eigen we! [t,t] and 


satisfying (5.11). Let h>O be fixed. 


Definition 5.3. A point ¢ € C([-h,O],R’) is said to be attainable if there 

area MewW anda (u,t,) e Q(U,7T) such that the corresponding response 

x(°3M,u) satisfies Xe nt (yOu e= Ca he abtatnaple sce. @ is aefined 
iia? Al ee aa 


Poe? = (¢ € C([-h,0],R™): € is attainable). 


Theorem 5.5. If the system (5.10) with initial condition (5.11) satisfies 


(9-12)-(5.20), then BR is compact. 


Proofs We first shov F@ is conditionally compact. Without loss of generality, 


mocume Le 7 Let (v*,T) « O(U,7), and for any (v,7) e {(U,7) define 
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Vitec) ie to a ie 
Cee = a 
vx(t) Lf - eee < To 


iene (v',T) ¢ 2(U,1)- Prem (5.10) and (5.16), 
d 
| =D(x(°59,v") ,t)| S v(t)[B + x +3 sv") ||]. 


mieese y>O such that 0 < &(y) < 13 let b = Bee ee Then) Clem 














[t,.totrl, 
IxCos@,v Dll, < lloll + 28¢2-0, )llell + 8CvIlxC-s9,¥" lly 
18 
+f v(s)[B + Ix(-39,v")Il Jas, 
ite 
OQ 
13 
IxC°39,v" |], < bl 1+28(T-a) Iilol] + bf v(s)[B+]x(>39,v" ll Jas, 
16 
and so 


B4ilx(+59,v" |, < bl 1+28(T-a,) I[Balloll] + bf v(s)[B4llx(+30,v")|l Jas. 
t 
0 


By Gronwali’s inequality, on [tysto+r], 


t 
Bellx(*sP,v' il, < bl 1+26(T-c,,) I{ B+lloll Jexplof v(s)ds}. 
t 


0 


In a similar manner on [tot7, t +2y], 


0 





oii 


5g 
Bal 59 v4 DIL, < BLL+28( 2-05) IEBAx(*50,v¢ Vly gTexpld/ —v(s8)as) 
O eet aye 
0 
eC a i 
<b [1+28(T-c) ] [B+||~l| Jexp{bf v(s)ds}. 
t 
0 
T-t6 
By a natural induction, if Ny = 1 + greatest integer in Lar ae 
ve No Tt 
(5021) B4l|x(es pe ila [1+28(T-a,)] [B+B,]exp{df v(s)ds} = K, 
7G 
0 
where By, is a bound on the compact set Y. We define ¥(+39,v,t)8 [t,,T] > 
R" by 
(5.22) Ger Oo, ©) etal acCoe@ et yecommc ¢ we (v,t) € O(U,7). 


From (5.16) and (5.21), for all t¢[t),T], 9 € ¥, and (v,t) ¢€ O(U,T), 
(5.23) | ¥(t5,v,7)| < Kv(t).- 


Bance f(v'(t),x(°39,v5,t) is measurable in +t, the w(e3p,v,t) are measurable, 
and thus by (5.23) integrable over LtosTI- Ey (9210) (oD (oneaeadd 
Bere °c@,v') ¢ Clap »T],X)y Ky? (see definition 3.1), where X is the 
7 
compact ball in R of radius Ke By lemma 3.1, C(La,,T]X)y x, is compact 
bs 


in C(La,T],R") Thus, by the Arzela-Ascoli theorem, the x(*3p,v') are 


uniformly equicontinuous on [a,,T]- This implies that 
R = {x who3P sv" )s pe ¥, (v,t) € Q(U,7)} 
2 : 


is an equicontinuous subset of Charen.) is bounded by K, and hence is 
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eonditionally compact. 

We now show @& is closed. Let £12 bp2 Saseee be @ sequence var 
points in @ such that Ck a as kK 39. BY Ghetdetimit temmeu Qe there 
exists a sequence @, ¢ ¥, k = 1,2,5,00¢, and a sequence (u,,t,) e 2(U,T), 


ies re such that 


Xe (GOR e Ue) = RIGS ic 
mene, ie Ts k 50 


4) 


as k75o0, 


AL Ak 
Let Wy, = 0°39, 5U,,t,) » By aoe2o. : | y 4%) | at <f Kv(t)dt, so as elements 
G 


ong L'{t),T] the functions vy form “9 bounded sequence. By (5.23) and 


k 
fos corollary Iv.S.11] the set (y,8 k = 1,2,00¢} is weakly sequentially com- 


pact in L'{t),T- Hence there is a subsequence (still denoted by Vy) which 
converges weakly in Tiles al to an integrable function Vo such thas 


P. ~9* ¢ ¥ as kom, and t, ~t* ¢7 as ko Thus, for each measurable 


i = [t).7], 


lim f W(t)dt = J hs (a aite 
he 


Since the x( + $P,5U)) are contained in the compact set C([a pT), xX) there 


ee Kv? 


exists a further subsequence (still denoted x(*30,,,u1,)) and a function 


¥ € CULO TL MDy xy 


uniformly in té [t,.T]s 


such that Ix(° 3, ut) -yl >0 as k—7, Hence, 


t t 
lim Jf d,[u(t,6)]x(@59,,u)) = , d[u(t,6) ly(9) - 


ae % 


Serine the function Z% [o,,7] —>R° dy 





De, 


a = ® bs 3 
ay 17 . 
z(t) = D(p*,t,) + f dotu(t,6) ly(@) + f Vo(s)ds, tS bigs fH 
% XO 


Using (5-10), (5-11), and (5.22) we have, for +t e¢ [t),T], lim x(t3o,,u,) = 
kK >» i 


2iG)., Thus z =y, and 


(5.25) Ix(-30,5ut)-2|, 20 as ke, 
(5.26) ae See 
OQ 
1 a0 
Z(t) = Dime, t_) + | ayh( 4,6) )2( 9) af Was dis cee gece oe 
O 0 O O- = 
a it 
O 0 
We now show that, as k 7, [see (5.24)] 
>.27) Me ont, 67 Pio Uk) = My byt, 3 Pa Ma! 2 “t¥-h,t* = bo 


Define tT (t,58) = ih Le +s}, (oe) = max{t,,t, +8}. For the “se | =n] 


0? *k 


such that t*+s < Lo: 


[x(t +s3p,,u,) - 2(t*+s)| < | x(t, +850), uh) - O,(t*+s)| 
+ |p, (t*+s) - 9*(t*+45)| 
+ 
< jalcs (+155) 59,944) = ,(t,)| 


+ |9,(47(t,58)) - O,(t#48)| 


. + |p, (t*+s) - p*(t*+s)| 
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puoce bt > t*. as ~k =>, 7 (4,55) = 


c uniformly in s as k-—7»%, so by 


O 


ime equicontinuity of C(La),T] x) the first term @o0€s to zero uniter 


Ky 


mies aS k—>% By the uniform equicontinuity of WY, the second stermeze. 
be zero uniformly in s as ko, Since lo, -*| 30 as “Kees Cheweniee 
term goes to zero uniformly in s as to. For the s é¢[-h,0O] such that 
(ee, to» 
| x( 4, 453, , ul )-2(t*+s)| < | x(t, +53), , ul) -x(t*+s39, , ut )| 

+ [x(t*+s39, ,ul)-2(t*+s) | 


< (9, (77(4)58)) 9, (t9)| 


ze 
ty [eC x(+s9, ,ut) ,t (t,8))-28(x(+sp,, ut) ,t*+s)| 


ara Oe aaa 


G¥4S 


+|x(t*+s39, , ul) -2(t*+s)| » 


By the eduicontinuity of Y¥ and ie nee as ko, the first term goes to 


zero uniformly in s as k7o, By C((Q,,T},x) x [t) 7] compact and 


¥,Kv 


the joint continuity of g [see (2.4)], since t, > t* as ke the second 


term goes to zero uniformly in s as k->. Sinee f Kv(@)d@ is absolutely 
continuous and Ved as K > G yuhe third) erm foes te zero Unuiermiy, 

in s as km By (5.25) the last term goes to zero uniformly in s as 

kK -—-o. Thus we have shown that (5.27) nolds. 


The proof that & is closed will be complete if we show there is a 


Uu 


9 such that (uy, t*) Seer 7p) Pastels 





JESTIE 


20) x($59* ju, ) eran) to St <t*. 


(Except for notation, the remainder of the proof is almost identical to that 
of Jacobs [18], theorem 4.1, following his equation (4.10). It is included 
here for completeness.) The subsequences (V5 kK >N}, N =1,2,5,002, also 
converge weakly to Voge Corresponding to each sequence (Vy > Nipeeenere 


is a sequence (Vig of convex linear combinations of the y,, k >N, such 


k? 
that each (Vi converges to Yo ah Tener (strongly) [8 ; corollary 


V.3.14]. The sequences ie: N= D205 olsouconverp ome Ns in 


measure [ 8; theorem III.3.6]. Thus, for each N = 1,2,3,..., there is a 


“2 P4 


subsequence of (Vey (still denoted (Wid) - such that (WE rs converges 


pointwise to WV. a.e. on [t),T], een Seer ce) Een Ey denote the sub- 


O 


set of [tT] on which (VE does not converge pointwise to Vo? 


[ermeeece,.-.. . Then the set Eo = Uae has Lebesgue measure zero. Let 


te[t.,T]\B, ve fixed. Let B, be a ball in C([a,,%]1,R°) which is large 


enough that x(+3),,ul) ¢ Bj, k= 1,2,3,... [see (5e21)]. Then, by (5.16), 


me. 20), and (18; theorem 2.4], the mapping x ¢« B, > f(U(t),x(*),t) is 


0 
feomeeee Thus, piven & >OQ, there is a On >QO such that xe By and 
Ilx-zl|, < 6, imply meu t)x( *)56) C J[P(U(t) ,2(*),t) ]- By (5.2) )eehere ioe 


Bositive integer N 
So 


Thus, when k>N, , £(U(t) ,x(°5,,uL) ,t) C Jp[P(U(t) ,2(°) ,t) J Since 
g 


such that k > Ng, implies Ix °50,, ut) -zil, < Oy: 


v(t) € P(U(t) »x(° 30), ut) ,t), ke 1,23 5c 7 ee ecougee Jol F(U(t) ,2(°),t)] 
Gs convex [see (5.19)], it follows that Via, (t)} © J f(U(t),2(°),t)]- 

€ 
Consequently, ¥() belongs to the closure of Jol f(U(t) ,2(*),t) ]- Since 


&€ >O was arbitrary, we must have V(t) ef ce ce tate VCs) é 


mou(s),z(*),s) ae. on [t,,T]- By (3-15) and [163 theorem 91), treves tema 
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aes . : 1 : 
measurable function Unt Lt, ,t*] —>R Suche taeqd Unt) é UGas a6 s eS Ee 


O 
and V(t) = (u(t) ,2(°),t) aces on [t,,t*]. Using (5.26), we have that 
@e0) holds. 

Since we have shown B@ to be conditionally compact and closed, the 
proof is complete. | 

Let (S,p) be a locally compact metric space, (X,d) a metric 


Space. The following more general statement of [185 theorem 2.2] is also a 


mecemal case of results in [17 3: chapter 2}. 
Lemma 5.1. Given a mapping Fs S ~ ¥(X), the following are equivalents 


i) F is uceSec. at ty € 85 


a it (t}, ead are sequences in S and X respectively such 
that Pe R(t), n= 1,2,3,00¢, and t, > ty, PLO, 88 8 ip) chen 
Cane 
Bee P(t) 


Let there be given a mapping J 3 [t,.T] > g(a ia onlyeae) Yue") 


MMUen 2S UsSeCe ON [t>.T]- Define 
- — o° CA ° qo 2 F | 3 
R= eth 5 ,u) eH eee 5P,u) «€ F(t,)) 


Theorem 5.4. Given (5.10)-(5.20), Y as above, and a emtinuous function 


nN 


p: C({-h,O1,R.) >R3 then if G@ is nonempty there exists (p*,u*,t*) ¢ 


é 


fx O(U,7) such that °5M*,u*) ¢ ZY, and 


‘teh te! 
PUKea hy gu 30% Ux) = min((t)! Ce B} 


moors By theorem 5.5 and lemma 9.1, @ is closed, and hence by theorem 9.5 


is compact. This and p continuous imply the result. 
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6. Partial Differential Equations and Examples 


The theory above may be applied to certain linear hyperbolic partial 
differential equations with boundary controls. For this discussion, subscript 
imo. xX denotes the respective partial derivative, and prime denovess cnc 
total derivative. Suppose we are given the equation 

6 : 

ico. 1) w, 4 (t,x) -¢ w(t, %) = QO, © € | Otc) eerec FO), 
fo oeanitial conditions 

fo. 2) (Ore f(x), w,(0,x) = £,(%) omy) Opeal 


and the boundary conditions 


(6.3) Aj (t)w,.(4,0) + By(t)w, (4,0) = G(t,w(t,0),w,.(t,0),w(t,9)), 


A,(t)w,.(¢,1) + B,(t)w, (1) G,(t,w(t,1),w,(w,1),w,(%,1)), 


where the initial functions satisfy the boundary conditions at +t = 0. 


Bitseis a controlled system if 


tI 


Go(t, 6, ¢, 7) Fo(t, u(t), 0,9, 7), 


G,(%,0,¢,7) F,(t,v(t),9,0,7), 


ve, ‘ 
and e) ls the control, We make the following assumptions: 


(6.4) 


Ho.) 


’ 
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£0 (x) end f(s) are absolutely continuous, with derivatives in 


ma Q, 1) e 


ie A. and Bs are CONtINUCGUS. cic G, are measurable in t and 


t 


; 2 
K, € Ly oh 0%) 8) such that IG.(s,y)| < K, (s) for every s € [0,~%) 


continuous in (w,w yw.) 5 ang shen icaChime Oni. CulmsZ Gong There existe 


Sid y © 4, = 0,4. 
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(6.6) For each s ¢€ [0,~), 
[Ag(s) - = B(s)] £0, [A,(s) + B,(s)] £0. 


Motivated by partiai differential equations and the paper by Ceo 


and Krumme [7], we assume a solution of the form 


| 
wat - 
e 


(6.7) i Glcp oly = (ae +=) + v(t - - 


Substituting this into (6.3), and setting 


a,(s) = [A,(s) + 38,(s)], Bj(s) = [Aj(s) - 3B,(s)], i = 0,1, 


we obtain 


(6.8) a (t)O"(t) + B(t)¥"(t) = Gt, £H(0) + J or(s)as ‘ Pa (sas, 
or(t) + W(t), ZOr(t) - Gv(t)) 
= E(or(+),V(-),8), OS 4, 
and 


a(t - S)o"(t) + B,(t - Sv"(t - 5) 


1 t t- 
= G(t - Z,fo(0) +f or(sjas +f “vr(s)as, 


QTM 


Ort) + NCE =F), Bort) (4 = 5) 
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L 
é 


= 6 ("02 eee 


By (6.6) it is proper to multiply this pair of equations by the matrix 








a 
0 ee Je 
1 
ar, (t - =) 
tl : a(t) | 
Pol) a,(t - =)84(+) 
we then obtain 
ab «a 
g(t) Pte vet =) 
a, (t - =) 
(6.9) is _ 
GBS (treo 
y"(4) ; a1 ( yeh =) Te Gee =) 
=~ E(0"(-),¥"(+), €) 
at, (+ — =) 
Z - SRA) | 
sey EglON(+)¥(4),¢) -§ — 4 G(Ot(+),¥9(+),t), 
0 a(t zi Ba (*) 
Oren st Se : 
—e¢ 


gon eee) ckecl ioe). wom eis O45 il. 


Te ee UE 
tor (4) - ayr(- 4) = 2h), 


o'(=) + yt(- =) = £,(4). 
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tae for x .¢ [0,1], 


See Se = 
o(%) = Sex) + B00, 
W(- 3) = - Seh(x) + 5, (x) 
G ea6 2 eee 
es st | I ’ 
(6,4) implies that o' on [0, mt and W! on [-<,0] are determined as 
oO 
absolutely continuous functions with L derivatives. We use (6.8) to deter- 
mine y' on [0, =]; by (6.5), (6.6), and (6.8), y' is absolutely continuous 


2 
oo 0, =] with an L derivative. Thus there is sufficient initial data 


Qlh 


an al 
to solve (6.9), with oe) ty = 


of a continuous solution (',¥'). From (6.5) and (6.9) we see that the solv- 


> theorem <. | gugrentees: ener cymereier 


tion is absolutely continuous, with a derivative in Ly ([0,%),R°). By 
construction, w(t,x) given by (6.7) satisfies (6.2) and (6.3). The derivatives 
of w(t,x) through second order obtained by formally differentiating (6.7) 

are derivatives of w(t,x) in the ordinary and generalized sense (the latter 
from an integration by parts). Thus w may be said to solve (6.1) in 

either the generalized sense or in the sense of almost everywhere (which does 
not seem to be well-established in partial differential equations). 


If we are given the terminal conditions 


wT, x) == 


*)s w,(T,x) = g(x) one LCs 


where g satisfy (6.4), we obtain, for x ¢ [0,1], 


of al 


c It 
or +2) = 5 el(x) + 5e,(>), 
x , a : 
TT rd aa ie Beh (x) + 56,(x), 
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exactly as for the initial conditions. These give terminal conditions as 


meuareet function for V4 on iT — =,T] and Tor “sori se). 


Remark 6,1. The form of the equation and terminal conditions above shows that 
it is reasonable to require that terminal conditions be given on [T-h,T] even 
Wiemmine hereditary dependence of the neutral equation is truly em the WG) 7) 


form, 


Remark 6.2, Instead of the equation (on). Suppose we Nave the coupled equa- 


ions 


Cy -1 


1! 


Meee Fleal conditions 


(Opps) =) 1) One) = eae cmon 


and boundary conditions 


Aj(t)i,(t,0) + B(t)v,(t,0) = a,(t,i(t,0),v(t,0)), 


A,(t)i,(t,1) + BL(t)v,(t,1) = @,(¢,4(t,1),v(t,3)). 


rn A - , oem , a 
Poteet and v be absolutely continuous, with derivatives in L [{0,1]3 the A. ; 


B, and g, satisfy conditions similar to (6.5) and (6.6). 


Assume a solution of the form 
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ogee ener id = XV LC ese Gia x VIC)I, 
alc 

i(t,x) = —-{w(t - x VIC) + o(t + xVE0)). 
AA 


As above, we obtain an equation of neutral type in and 9, whose solution 
2 
fomeeeoe absolutely continuous with locally J, derivative, This yields 2 


; ; ; 2 4 ee 
Same (1,v), with (i ee) E Ly oe (l9,%) x [0,1],R ), which satisfies the 


al 
tex 
coupled equations in the generalized sense, 


Remark 6.3. It is not always necessary to have conditions (6.6) hold. For 


example, assume 


A.(s) = Bo(s) = 0, [A,(s) - =B,(s)] fe) tex. AL YS 6), 
Memes coundary condition at x =O can be used to solve for w' as a fune= 
tion of '*, we substitute this into the boundary condition at x =1 and 
obtain an equation of neutral type in g* alone. The equation may then be 
@Omyerted to an equation in either W, OY Wy. THES ~ procedure wile conneer lor 


with the coupled equation mentioned in remark 6,2, was eisvetsl che sua wavieye, ||, D> 


eoomlon |. 


Example 6.1. Consider the transmission line given by 








~6 
where E, = 200v, R, = HOON, L, = lh, [E,| < 75v, C = 10 f, and L = 0.16h 
puese last two values Corréspond Go a transmissi onmigmee ous, 10° meters 
long). The equations are 
0.16i,(t,x) = -v (t,x), 
=o ; 
10 v, (t,x) = -i,(t,x), 
with boundary corditions 
O = 200 - v(t,0), 
i, (t,1) =e LOL abe) = B, (+t). 
If we assume a solution as in remark 6.2, we obtain the equations 
W(t) = o(t) +0.4, +t >0, 
(6.10) Wi(t) + Y'(t-h) = -G0O¥(t) - 0.SE,(% - ) +520, + SS 


where h = 2NIC = 8 x gn sec. Hy @ Glifercnt Sequence Of Subse auelons 


(similar to those detailed in Slemrod [25]) we obtain the equation 
Soli(t,1) + i(t-n,1)] = -800i(+,1) - E,(t) - E(t-n) + boo, t oh. 


ieee Control 1s the value of E., these are equations of neutral Gype with 


ies 


délays in the controi. 


Suppose we are Siven initial conditions 1(0,x) =O, 4(0,x) = 200: 





ate ie 


h 
O72 sone O; 5], o(s) = -0.2. Thus we may take Gey Jie) 


h : ee eee h es 
as the equation for t >, with initial function y¥(s) = 0.2, s € |- 5, al. 


it 


h 
then on [- 50]; VCs) 


To obtain an initial function for the equation in i, one must use another 
equation such as (6.10), and the initial function i(s,1), s € [0,h], will 
depend on values of E,(s) HO y use weal 

Attempts were made to determine the values of E(t) (actinic tases 


Semerol variable) which would drive to the constant function 


ten, tele} 
€(6) =0.4, @ « [-h,O], in minimum time t*. The problem of hitting i(t*,1) = 
O.4 in minimum time was solved, but the trajectory could not be held at 

i(s,l) =0.4 for s ¢« (t*,t*+h]. Despite repeated efforts, a solution was 

not obtained for the problem with a function target. 


We now consider a less complicated version of problem 4.3, and the 


corresponding statement of theorem 4.3. Assume the equation has the form 


k(t) + Ak(t-h) = Bx(t) + Cx(t-h) + k(u(-),t) 


n-1 ee : ; 
TR 6 Welialn erb-ceisl = abigbagakshil aaiblakermatojal We o.< We wish Cocdrive Go une prCeewace 


ele 
C* function ee cla) Re, ¢ £0, in a manner such that the function 


Ab 
J(u) = f f(x(s),u(s),s)ds is minimized over a given class of controls, Q. 
0 
Assume that {f(x(t),u(t),t): ue 2} and (k(u(*),t): uv € 2} are quasiconvex 


families of functions (for example, satisfy the conditions of lemma 3.3). 


Theorem 6.1. Given the assumptions aveve, Leu “us. be dn opuimal Conurol yeu 

response z. Then there exist a row n-vector valued function w defined on 
PR O 

[0,°), a real-valued function 2% = 2\,-A, defined on R, and a real number a, 


such that 


i) , is a non-increasing function of bounded variation, continuous 


from the left, % =O on (0,”), 4, constant on (-~,-h], 





Tees 


ele yess a < Op | o| + var A + var dr, >O0. 


[-h,=) ~  [-h,») © 
iL) W ds eee bs, 
isi Ot 1 
WT) = (-¢(0)A(0),a°), 
Om : A O 
Ws) = (J (@)ad(6),a°) - W(s+h) 
Sait Ca) 
ip m0 1 B O 
+f va) da + f W(a) stom 
s+h O O S 3 


S-(2(a),ux(a),a) 0 


: s € [O. me 


iii) the following maximum condition holds: 


r — /x(u(+),8) r [ x(u*(*),s) 
f Ws) ds < J W(s) ds 
0 (VAS) TSS) 0 f(2(s),u*(s) a) 


for ali we (2. 


Theorem 6,1 is applicable to each of the following examples; graphs 


of the corresponding optimal trajectories and optimal controls are at the end 


Oiewure Chapter. 
Example 6.2. Consider the equation 
A(t) = x(t- 0) Gaye bc Oe 1), 


here 





IES 


g Opes << 6), _ 
H(%,0) = n(t,6) = 0. 


Bl o-sOmea ee 
Bet £ = 3, initial function 9(@) = 1, @ e [-1,0], target function (0) = l=) 
a 
peep -1,0], and cost function J(u) = / u“(+)at. Augment the system as in re- 
O 
mark 4,4° the problem is now in the form of problem 4.4. The adjoint matrix 


= given by Y4o(S, +) = Yo,(s,t) = 0, 


OF 1S Ss 
¥,,(s, +) = 


Ke takers tla an Caer 
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An optimal trajectory and control are 


inet st, te Herat 7 t ¢€ (0,1), 
WAGE) $ + st, Cece | lee eee) = - 3 prem cigs =) 
Mt =, = t € (2,31, ~g, t € (2,3). 


IL 
4? O€ (-o, -1], 
O 8 
eG OF = ol. | ou Se 3 6 € (-1,0], 
Q, sl (0,™)3 


b 
(3 all). s ¢€ (our 
2 

then ¥(s) = “3; Slee Sec eeea 


8 
\ (=e -1), s ¢ (Ar 2c 


The integral maximum condition is equivalent to the pointwise condition 


4 


V u*(s) 
H( :) <2) ( 2 ; aCe Oleh) 


Vv ux (s) 


for all veéR. This implies 2u*(s) = vaCeye Theorem 5.2 guarantees that 


the solution given is optimal. 


Example 6.3. Consider the same problem as example 6.2, with the added restric- 


Pelomde that |w(s)| < 2, s ¢€ [0,5]. Then an optimal trajectory and control are 





iil 


mE be 
l + Ts eS Bere Ty ice (O530s 
a Sa | koe 
Zt) = ) 5+ Ft, te [1,2], eGo ay eS 2), 
= 5 a 
Nate) be Peo an an C2eaie 
al 
pe O€ (-0,-1], 
O f 
Let <@ = =-1;, xe BD) een eo al(6) || 
0, 6 € (0,%); 
a Onl 
(3, a ep se Copan 
then Wi S)oe Gal a) © os eG. 
f a] 2 
(- mot) ¢ s ¢ ( ~~) - 
iiemiaxamum condivion 1s as berore, except that only ve toe are or- 
sidered. 

6 . = ‘S . Bp, 
Example 6.4. Consider the same problem as example 6.2, with T = Then an 
Speime! trajectory and control are 

16 i 16 i 
l+jet, te > 7? t € (0, 5), 
gel | 1. iL ih 
7 Bee at ae [s, 1], coe t é€(s, 1), 
met) = 
a7 Aaa 3 L 3 
350 2 eye té SG: ae u(t) = a 3 ) ie ee 5), 
if Dee, 6 3, 
5 -t ) te (5, 3], SUG ee t <« (5, 2), 
26 
” al) ) te (Bs A). 





Let a = -l, 


then Ws) = 





The maximum condition is as in example 6.2. 


Example By, 


Beg) = 


RO) oe 


NOP 


eG we) © bee 
too geo c [2 =, 


Then an optimal trajectory and control are 
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we ) Gc (-0, -1], 
oh 
a 5) O«€ (-1, - 3], 
22 i 
aS) ) Ze (- 50], 
\ Os @ € (0,)3 
an 
Ss € (0, 3)» 
ale 
Ss € (5, Dh 
Sosy 2), 
D) 
se (5; 2) 
s € (2, 3). 


Consider the same problem as example 6.2, except that 


Al 
I. 


3) 





ue 


an i lk i 
L- 35 4, LREVO, 5]; 7 eee ie 1G. 35)» 
2 fi aE il 
Sees te ls yi), ts, t <€ (a) 1), 
i , dE ‘ dD 
zi - Fat ge eae eee 5] - A 5a oe Ge 5) 9 
Z(t) = ux(t) = 
i Anal 5) i 
-5 45st, t € (5, 21, 5, te (%, 2), 
it 2 if 2 
a 7 t ? mE |e, 5], 2 2 2 yas), 
e) 1 
-Z+t , te[Z, 3], 3) ee 
L 
9? Ge (-»,-1], 
oa Ge (-1,- =|, 
eu Of = =, USD) = ; 


iL ilk 
3? BAe ( - 520), 
( 0; GO € (0,~); 


iL ak 
(- i=) -1), se¢ (0, 5)» 


OY 
Ne 

! 

b- 
ed 
Ne 

ef 

ran) 
vVWwv—, 
Mo} eR 
Ne 

| ad 
ed 
Ne 


then v( S) = 


(-$, -1), se (2,9), 


(%-1), se ( 


The maximum condition is as in example 6.2. 


Example 6.6. Consider the equation 
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x(t) = H(t) - k(t-2) + u(t), € € [0,7]; 


here 


Oj uv = 
u(t,6@) =0, 7(t,6) = =I “to Ce 
Cc) ll, 


foot = 2, initial function (6) = 0, 6 € [-1,0], target function (6) "=e, 
T 


peo 0], and cost function J(u) = if plese. Augment the system as in 
O 


remark 4,4, The adjoint matrix is given by Y,5(s,t) OF 


iH 
NI 


Yp,(s,t) 


o~ 
tA 
Gin 
~~ 
I 
oo 
ct 
tA 
ee 
ad . 
Gis 
! 
ij 
i 
Of) 
1A 
ct 
Ne 


Yoo(s,t) = 


Pemeetimnal trajectory and control are 


Sian sinh (V2 t) | 


GE [O ik 
>) 3 2) 
2 sinh Ae 


Z(t) = 
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1 


7 (V2 cosh (J2 te sinh(V 2 ty | eek ae tne (Oise 
2 Stee 


bo) = 


sinh (V2 (t-1)] , (1+t) 


2 sinhvV2 - 





; peat G2) 


Let a = -l, tean(t-2) = dB(t), where 


iav2 counNeie t € (~0,1], 
etc) = ee fexp{(V241)t- V2} = exp{-(V2-1)t+ V2}] + (taew Gale) - 
Simin 2 
O, : tae (2,0) 3 
TE levee! 
(eae cosh(V 2s) - sinh(V 2s) ] + 1=8,=1) sco (One 
Sinhve 
¥(s) = 
(sul 2(s-1)] 2 leshaib Pa (2), 
slall@lel J2 


The maximum condition is as in example 6.2, 


Example 6.7. Consider the same problem as example 6.6, with T = 3, | u(s)| <k 
ert = 
for s ¢€ [0,3], and cost function J(u) = f x(t)dt. We do not have to augment 


this problem; the adjoint function is given by 
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0 7b. aoe 
zee) pel eae Sk, 
Y¥(s,t)= 
a ee ee ee << 8 <x teil 


2 
re ae me eye 2s 
ave =) eee z Ne ee : oP t=) < 8 <= bec, 


An optimal trajectory and control are 


Meee ; t € [Gas 
gO) 2 4 ; ee (fas, LL), 
z(t) = Ao) Sate Dye ; : tent dele 
BAO) “a (t- aye ot ~2(t-2 ies EO es t € [l+w,2], 
met ; + @ (ele 
= , +t € (0,a), 
Mt , +t € (a,2), 
uX(t) = 
ee eae ee) : , +t € (2,240) 


(t-2) ,.(t-1-0)_.(t-1) 


AC Gemetee -t+(t-3)e t € (24+w,3), 


Poere cd 1S the solution of (hun eee a[3+e° ], and is given approximately 
by w = 0.531, si age 1.599 . 
O ~<a » oe hosel, 
Let @ ~ =-1, A(@) 








j2% 


palo1 pete: (ieee =o nee lees mes See (0/1) 


then WC) ere Boies ea ; S einer 


O eee (255)c 


if) . ; : : Batts . 
@ is given approximately by q* = 0.889. The maximum condition is y(s)v < 


eerme(s) a.e. on (0,3), for all vw ¢ [-=1,1). 


Remark 6.4, Example 6.2 was first solved for the equivalent problem of driv- 


ing to the point x(2) = 2 with the cost function 


a a 
i] Value + f rlek(t) 1-at é 
0 a ; 
a D @ 
ef {u (%)tu(t)}at + 2f u(t-1)u(t)dt+1 
O Ae 


J(u) 


iF 


i o 
fx (t)at + f (LE(t)-k(t-1)]° + (14k(t) Jat, 
O ale 


using theorems 4,2 and 5.1 and the information from the Euler equation (see 
El'sgolfe [9, p. 220]) that extremals consist of straight Line segments, This 
equivalent problem also satisfies the sufficient condition of Hughes [ 16, 
section 3]. Knowing the solution to example 6.2, example 6.3 was worked di- 
rectly with the action of the restraint and theorems 4.3 and 5.2. Examples 6.4 
and 6.5 were solved by theorems 4.3 and 5.2 with the assumption that the 
optimal trajectory would consist of straight line segments. Example 6.6 was 
solved in the equivalent form of driving to the point x(1) = 1 with the 


cost function 





Le2 


J(u) 


il 


1 9 2 
f (a(t) # [x(t)-t] Jat 
0 


f (Lk(t)=x(t)]° + [x(t)-t]Jat, 
O 


using the Euler equations and theorems 4.2 and 5.1. The solution in example 
6.7 was determined by inspection and checked with theorems 4,2 and 5.1. 
Examples 6,2, 6,6, and 6.7 were solved before the usable form of theorem }.3 
was determined; unsuccessful attempts were made to show that these examples 
satisfied theorem 4.4 with a®° = -1. One probably will nog be able ems 
problems using theorems 4,3 and 5.1 alone; equivalent problems in the form of 
problem 4.2 (possibly requiring a bounded state variables constraint) or the 


calculus of variations can provide a great deal of information, 


Remark 6.5. Pontryagin, Boltyanskii, Gamkrelidze, and Mishchenko [23, chapter VI} 
po1nG out thet in problems with bounded state variables the multiplier func- 
tion generally has jumps. These occur when the optimum trajectory enters 

or leaves the boundary and when the optimum trajectory follows the boundary 
Memeccea pOlnt where the boundary is not smooth. Thus we expect the jumps due 
to the endpoints of the target functions in the examples above, and the jump 
due to the corner in the middle of the target function in example 6.5. Since 
the multiplier satisfies an equation similar to the equation for Y(s,t), we 
expect the jumps to be propagated once they appear. The extra jump in 

example 6.4 comes from the trajectory and the relationship between T and h. 
One normally expects Zz to be discontinuous at tos if the equation is of 
neutral type this discontinuity is propagated forward in time. If T is not 
oimencesral multiple of h, the discontinuity will fall in the interior of 


[T-h,T]; if € is smooth at that point, the control must be discontinuous to 





block the propagation of the discontinuity in 2 


ube TEQGUIrTeS a COrreSpondane dicecnGinvic, 1a 


Since 


vy determines 


U, 


NM x« 


g 


| 
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